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Abstract 


The  results  of  formative  assessments  are  regularly  used  to  infonn  important  instructional 
decisions  (e.g.,  targeted  intervention)  within  a response  to  intervention  (RTI)  system  of 
teaching  and  learning.  The  validity  of  such  instructional  decision-making  depends,  in 
part,  on  the  alignment  between  formative  measures  and  the  academic  content  standards 
on  which  classroom  instruction  is  based,  as  well  as  the  technical  adequacy  of  the 
measures  used  in  RTI  applications.  In  the  following  technical  report,  we  describe  the 
development  and  scaling  of  the  easyCBM  Common  Core  State  Standards  elementary 
school  mathematics  measures  for  use  within  an  RTI  framework.  Within  a given  grade, 
math  items  from  two  distinct  item  pools  were  calibrated  to  a common  horizontal  scale 
using  a 1 -parameter  Rasch  analysis.  The  results  of  the  scaling  were  then  used  to 
construct  13  alternate  forms  designed  to  be  of  comparable  difficulty  - 3 forms  designated 
for  seasonal  benchmark  screening  and  10  designated  for  progress  monitoring.  Prior  and 
subsequent  grade-level  math  items  were  added  to  the  benchmark  test  fonns  as  a basis  for 
constructing  a common  vertical  scale  in  the  future.  Evidence  of  technical  adequacy  is 
reported  in  appendices  by  both  test  form  and  by  the  full  bank  of  CCSS  items  piloted  and 


scaled. 
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The  Development  and  Scaling  of  the  easyCBM  CCSS 
Elementary  Mathematics  Measures:  Grade  2 

The  mathematics  measures  from  the  easyCBM  interim-formative  assessment  system  for 
grades  K-8  were  designed  for  use  in  a Response  to  Intervention  (RTI)  framework  (Alonzo,  Lai, 

& Tindal,  2009a,  2009b,  2009c;  Alonzo  & Tindal,  2009a,  2009b;  Lai,  Alonzo,  & Tindal,  2009), 
which  can  be  used  both  for  whole-school  improvement  (Shores  & Chester,  2009)  as  well  as  to 
identify  students  in  need  of  special  education  services  (VanDerHeyden,  Witt,  & Gilbertson, 
2007).  A functional  RTI  system  hinges  on  the  use  of  measures  that  are  aligned  with  adopted 
content  standards,  so  that  instructional  decisions  are  based  on  results  from  student  assessment 
that  reflect  what  they  are  learning  in  their  classrooms  (Fuchs  & Fuchs,  2006).  The  easyCBM 
measures  were  originally  developed  to  align  with  the  National  Council  of  Teachers  of 
Mathematics  (NCTM)  Focal  Points  Standards  (Nese  et  al.,  2010),  that  were  adopted  by  many 
states  as  the  basis  for  teaching  mathematics. 

In  2010  the  Common  Core  State  Standards  (CCSS)  were  released  as  a guide  for  preparing 
students  for  college  and  careers  (National  Governors  Association  Center  for  Best  Practices  & 
Council  of  Chief  State  School  Officers,  2010).  The  subsequent  endorsement  of  the  standards  by 
the  U.S.  Department  of  Education  (2010)  and  their  recommendation  of  creating  assessments  that 
provide  improved  measurement  of  student  progress  toward  skills  outlined  in  the  CCSS, 
coincided  with  a majority  of  states  adopting  the  CCSS  as  the  basis  for  student  instruction  and 
assessment  (National  Governors  Association  Center  for  Best  Practices  & Council  of  Chief  State 
School  Officers,  2010).  Similarly,  developers  of  curriculum-based  measurements  (CBM),  long 
used  to  monitor  growth  toward  general  outcomes  and  skill  mastery  through  multiple  short, 
technically  adequate,  and  sufficiently  equivalent  test  forms  (e.g.,  Deno,  2003;  Tindal,  2013),  also 
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began  work  to  align  their  measures  with  the  CCSS.  A study  of  existing  easyCBM  math 
measures  to  determine  the  extent  to  which  they  were  in  alignment  with  the  CCSS  followed  in 
2012  (Irvin,  Park,  Alonzo,  & Tindal,  2012a,  2012b;  Park,  Irvin,  Alonzo,  & Tindal,  2012). 

The  2012  alignment  studies  found  reasonable  alignment  between  the  easyCBM 
mathematics  measures  and  the  CCSS  for  grades  K-5;  however,  gaps  across  specific  grade-level 
domains  and  standards  remained.  Identification  of  these  gaps  provided  the  basis  for  developing 
new  technically  adequate  K-5  CCSS-aligned  math  items  and  test  forms  for  use  in  the  easyCBM 
interim-formative  assessment  system  and  in  RTI  application  - the  development,  piloting  and 
scaling  of  which  are  discussed  in  this  technical  report. 

Methods 

In  developing  the  easyCBM  CCSS  mathematics  measures,  we  focused  on  alignment  with 
the  CCSS  and  accessibility  for  diverse  student  populations  with  a range  of  achievement  levels. 
The  following  section  outlines  the  process  we  used  to  develop  math  items  and  subsequently 
assemble  benchmarking  and  progress  monitoring  test  forms  for  use  in  RTI  frameworks  of 
teaching  and  learning. 

Item  Development 

The  K-5  CCSS  in  mathematics  are  comprised  of  four  (Grades  1 and  2)  or  five  (Grades  K, 
3-5)  domains  that  are  further  divided  into  21-28  individual  standards.  Though  some  grade- 
level  standards  were  further  divided  into  more  granular  sub-standards,  such  sub-standards  were 
treated  as  part  of  the  larger  standard;  thus,  an  item  written  to  a given  sub-standard  was 
considered  as  being  written  to  its  parent  standard.  A total  of  3,000  new  CCSS  math  items  were 
written,  500  items  in  each  of  grades  K-5,  based  on  the  gaps  in  CCSS  coverage  identified  through 
previous  research  (Irvin  et  ah,  2012b;  Park  et  ah,  2012). 
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Item  writing  and  review  training.  Two  groups  were  recruited  to  develop  CCSS  math 
items  based  on  their  experience  and  expertise  in  mathematics  teaching  and  learning.  Four  item 
writers  for  each  of  three  grade  bands:  K-l,  2-3  and  4-5,  and  six  item  reviewers,  one  for  each  of 
grades  K-5,  were  recruited.  One  of  the  original  four  item  writers  voluntarily  dropped  from  the 
study,  and  thus,  two  item  writers  split  their  duties  within  the  grade  4-5  band.  Writers  and 
reviewers  were  recruited  to  develop  and  review  math  items  appropriate  to  their  expertise.  On 
average,  item  writers  and  reviewers  had  about  14  years  of  teaching  experience  in  math  education, 
ranging  from  3-32  years.  Each  item  writer/reviewer  held  a Bachelor’s  degree  and  16  of  the  18 
(including  all  reviewers)  also  held  a Master’s  degree.  Item  writers  were  recruited  in  a manner  to 
balance  expertise  across  general  and  special  education  classrooms.  All  item  reviewers  had 
demonstrated  expertise  in  both  general  and  special  education  and  also  worked  in  district 
leadership  positions,  for  example,  as  math  coaches  or  curriculum  developers. 

In  December  2012,  item  writers  and  reviewers  attended  one  of  four  mandatory  2.5-hour 
training  webinars,  led  by  the  lead  project  researcher,  who  was  onsite  at  the  offices  of  Behavioral 
Research  and  Teaching  (BRT)  at  the  University  of  Oregon.  The  webinar  training  consisted  of 
two  main  sections.  An  initial  study  overview  reviewed  the  context  of  the  research  study  and 
described  item  writing  and  reviewing  duties  in  detail.  Specifically,  for  each  new  CCSS  math 
item,  item  writers  and  reviewers  were  required  to  write  a stem  (question  or  prompt)  and  three 
answer  choices  (one  correct  and  two  distractors)  that  were  similar  in  length  and  complexity  level. 
When  constructing  distractor  options,  writers  and  reviewers  were  informed  that  they  should  be 
relevant  to  the  math  skills  required  by  the  problem  - ideally  targeting  a range  of  plausible  student 
mistakes.  Item  writers  and  reviewers  could  also  include  graphics  for  the  stem  and/or  answer 
options  when  relevant  to  the  problem.  When  graphics  were  called  for,  item  writers  provided  a 
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rough  sketch  and/or  description  of  the  graphic,  and  a graphic  artist  later  created  digital  images 
for  each  of  the  graphics.  The  second  training  section  focused  on  techniques  around  effective  and 
appropriate  item  writing,  and  included  principles  of  quality  item/test  development  as  outlined  by 
Haladyna  (2004)  and  Downing  (2006a,  2006b),  and  those  around  Universal  Design  for 
Assessment  (e.g.,  precise  construct  targets,  accessibility  to  diverse  populations,  lack  of  bias)  as 
outlined  by  Thompson,  Johnstone,  and  Thurlow  (2002). 

Throughout  each  section  of  the  webinar  training,  item  writers  and  reviewers  were 
required  to  collaboratively  participate  in  activities  designed  to  ensure  deep  understanding  of 
study  roles,  including  observation  and  discussion  of  math  items.  In  other  words,  a variety  of 
math  items  were  shown  to  writers  and  reviewers,  followed  by  a discussion  of  why  they  met  or 
did  not  meet  the  principles  of  quality  item/test  development  or  why  they  were  (or  were  not) 
aligned  to  the  CCSS.  The  lead  researcher,  writer  and  reviewers  brainstormed  and  discussed 
specific  ways  in  which  items  could  be  altered  to  meet  item  design  principles  or  better  align  to  an 
identified  CCSS  in  instances  where  non-examples  were  shown.  Particular  attention  was  paid  to 
crafting  effective  distractor  options  and  graphics  options  associated  with  math  items.  Effective 
multiple-choice  items  typically  have  one  distractor  option  that  is  “closer”  to  the  correct  response 
and  one  distractor  that  is  “further”  from  the  correct  response  (Haladyna,  2004)  - the  third 
response  option  being  the  correct  answer  for  a given  math  item.  Graphics,  whether  for  the  stem 
and/or  answer  options,  are  included  for  a math  item  only  as  necessary  to  meet  a targeted  content 
standard  and  to  critically  consider  and  solve  a given  math  problem.  This  was  the  manner  in 
which  writers  were  asked  to  write  answer  options  and  include  graphics  for  this  study.  At  the  end 
of  the  training  webinar,  the  item  writing  process  was  again  described  in  detail,  including  the 
specific  roles  of  item  writers  and  reviewers,  in  connection  with  expected  timelines  and 
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deliverables.  The  PowerPoint  Slides  used  in  the  webinar  training  were  adapted  from  those  used 
in  Anderson,  Irvin,  Patarapichayatham,  Alonzo,  and  Tindal  (2012),  and  are  shown  in  Appendix 
A. 

Item  writing.  In  general,  item  writers  and  reviewers  worked  concurrently  to  write,  edit 
and  revise  500  new  CCSS-aligned  math  items  (four  item  sets)  in  each  of  grades  K-5. 

Specifically,  item  writers  wrote  250  new  math  items:  125  items  (in  each  of  two  items  sets)  for 
each  grade  of  their  assigned  grade  band  (i.e.,  K-l,  2-3  or  4-5).  For  example,  “item  writer  1”  was 
assigned  to  write  125  math  items  in  each  of  Grades  K and  1 to  align  with  the  targeted  CCSS. 
Table  1 displays  the  math  item  writing  plan  for  second  grade  by  item  set  and  CCSS.  Item  writers 
iteratively  wrote  and  submitted  items  to  the  lead  researcher  (and  item  reviewers)  in  small  batches 
between  January  and  March  2013,  typically  submitting  between  10-25  items  at  a time  for  further 
review  and  editing.  Throughout  the  iterative  item  writing  process,  item  writers  and  reviewers 
were  in  contact  with  the  lead  researcher  by  email  and  phone  to  hone  their  skills,  and  thus,  the 
quality  and  consistency  of  math  items  produced. 

Item  review.  We  conducted  three  separate  stages  of  item  review  prior  to  item  scaling: 

(a)  review  by  contracted  item  reviewers,  (b)  an  internal  review  by  University  of  Oregon 
education  researchers  at  BRT,  and  (c)  an  external  review  by  individuals  without  prior  connection 
to  the  items.  The  first  review  took  place  concurrently  with  item  writing,  in  which  a single  item 
reviewer  was  assigned  to  review  all  500  math  items  for  a given  grade  level  (K-5).  Prior  to 
contracted  item  reviewers  receiving  items,  the  lead  researcher  briefly  reviewed  the  small  batches 
of  submitted  items  for  completeness,  accuracy  and  features  consistent  with  effective  item  writing 
discussed  during  the  webinar  training  (e.g.,  effective  items,  Universal  Design  for  Assessment), 
subsequently  passing  them  to  the  assigned  reviewer  concurrent  with  the  item  writing  process. 
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Item  reviewers  then  carefully  reviewed  and  edited  each  grade  level  math  item  for  completeness, 
accuracy  and  features  consistent  with  effective  item  writing  discussed  during  the  webinar 
training  - this  included  editing  for  distractor  and  graphical  option  appropriateness.  Further, 
because  item  reviewers  had  access  to  125  items  from  each  of  four  item  writers,  they  also  edited 
math  items  that  were  too  similar  (across  item  writers)  while  attempting  to  maintain  the  content 
and  skill  intention  of  the  item  writers. 

For  the  second  stage  of  item  review,  all  math  items  (subsequent  to  graphics  development 
- see  below)  were  uploaded  to  a secure  website  to  be  reviewed  as  students  would  see  them  in  the 
online  easyCBM  formative  assessment  environment.  Math  items  were  then  assigned  and 
reviewed  internally  by  a group  of  university  education  researchers  from  BRT.  Reviewers 
included  university  faculty  and  doctoral  students  in  education  research  with  experience  in  test 
and  item  development.  During  the  internal  review,  reviewers  again  analyzed  and  edited  items 
for  mathematical  correctness  while  also  looking  for  possible  bias  or  features  inconsistent  with 
Universal  Design  for  Assessment  principles.  Additionally,  internal  reviewers  ensured  that  all 
items  were  formatted  in  a consistent  manner.  All  reviewers  during  this  stage  had  been  trained 
and  taken  part  in  a previous  internal  review  of  middle  school  math  items  (Anderson  et  ah,  2012), 
and  thus,  were  deemed  competent  to  serve  on  the  internal  review  team  in  the  current  study.  A 
team  of  external  reviewers  without  prior  connection  to  the  item  development  conducted  the  final 
item  review.  We  contracted  with  three  individuals  who  did  not  have  item  writing  or  mathematics 
teaching/assessment  experience  to  review  math  items  (on  the  secure  website)  for  mathematical 
accuracy,  consistent  formatting,  and  audio  file  accuracy  (see  below).  Our  intention  behind  this 
manner  of  external  review  was  to  have  a “fresh  look”  at  the  math  items  apart  from  the  item 
writers,  various  reviewers  and  the  lead  researcher,  all  of  whom  had  had  considerable  prior 
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contact  with  the  math  items. 

Graphics  and  audio  development.  We  contracted  with  a professional  graphics  artist  to 
produce  images  for  all  math  items.  The  artist  used  Adobe  Illustrator  to  develop  simple  and  clear 
line  drawings  without  shading  consistent  with  Universal  Design  for  Assessment 
recommendations  (Thompson  et  ah,  2002).  The  artist  produced  graphics  only  when  explicitly 
requested  by  the  item  writer/reviewer  - a development  option  for  the  stem  and/or  the  answer 
options  for  a given  math  item.  The  artist  produced  each  item  graphic  based  on  either  a detailed 
written  description  or  a hand-drawn/electronic  version  (e.g.,  a jpeg  found  on  the  Internet) 
provided  by  an  item  writer/reviewer.  Graphic  images  were  iteratively  edited  based  on  feedback 
from  the  three  review  stages.  We  also  contracted  an  individual  to  produce  audio  recordings  of 
written  text  in  all  math  items.  In  the  easyCBM  online  assessment  system,  students  have  the 
option  to  click  on  a speaker  button  next  to  the  stem  and/or  distractor  answer,  which  results  in 
having  the  text-based  portions  of  the  item  “read-aloud”  to  them.  Audio  recordings  were 
reviewed  and  revised  as  necessary  during  the  second  and  third  review  stages  during  item 
development. 

Scaling 

We  carried  out  four  primary  steps  during  the  scaling  of  the  new  K-5  CCSS  math  items: 

(a)  developing  a piloting  plan,  (b)  selecting  anchor  items  from  the  existing  NCTM-based 
easyCBM  and  the  new  CCSS  math  item  pools  to  create  pilot  forms,  (c)  recruiting  subjects  and 
piloting  the  items,  and  (d)  calibrating  grade-level  items  to  a common  scale. 

Piloting  plan.  For  each  of  grades  K-5,  we  developed  a common  piloting  plan,  comprised 
of  15  total  pilot  forms,  to  guide  pilot  form  creation.  We  included  32  total  math  items  in  each 
form  for  grade  K-l,  and  41  total  items  for  grades  2-5.  Of  the  32  or  41  items  in  a given  pilot 
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form,  we  dedicated  5 horizontal  anchor  items  to  link  to  the  previous  pilot  form  and  5 horizontal 
anchor  items  to  link  to  the  subsequent  pilot  form.  For  example,  pilot  form  2 had  5 anchor  items 
linking  to  pilot  form  1,  and  5 anchor  items  linking  to  pilot  form  3.  This  meant  that  there  were  22 
unique  math  items  in  each  of  the  grade-level  pilot  forms  for  grades  K-l,  and  3 1 for  grades  2-5. 
Of  the  10  total  anchor  items  within  a given  pilot  form,  5 were  selected  from  the  existing 
easyCBM  item  pool  - items  originally  written  to  the  NCTM  Focal  Point  Standards  (Nese  et  al., 
2010),  though  deemed  aligned  to  the  CCSS  in  recent  alignment  studies  (Irvin  et  ah,  2012b;  Park 
et  ah,  2012),  and  5 were  selected  from  the  new  CCSS-based  item  pool.  For  simplicity  and 
clarity,  these  two  pools  will  hereto  be  referred  to  as  NCTM  and  CCSS  item  pools,  though  it 
should  be  noted  that  all  items  used  in  this  project  from  both  pools  had  been  deemed  aligned  to 
the  CCSS  (the  full  combined  CCSS  item  bank). 

By  including  horizontal  anchors  from  both  item  pools,  we  were  able  to  more  than  double 
the  size  of  the  overall  item  pool  from  which  we  would  select  items  to  create  the  operational 
CCSS  test  forms  by  calibrating  the  two  original  pools  to  a common  scale.  Additionally,  this 
saved  valuable  item  writing  and  review  resources.  It  should  be  noted  that  unlike  the  piloting 
plan  used  for  the  easyCBM  CCSS  middle  school  math  measure  development  study  (see 
Anderson  et  ah,  2012),  vertical  (across-grade)  anchor  items  were  not  included  in  the  K-5 
piloting.  Rather,  we  included  prior-  and  subsequent-grade  math  items  in  the  operationalized  test 
forms  for  grades  1-5  (and  prior-grade  items  for  grade  K)  in  order  to  calibrate  a common  scale 
over  the  2013-2014  academic  year,  reasoning  far  more  students  would  provide  item-level 
information  for  the  operationalized  items  as  a basis  for  future  review  of  technical  adequacy  of 
items  and  test  forms  (see  fonn  creation,  below).  The  K-2  piloting  plan,  showing  the  number  and 
placement  of  horizontal  anchor  items  selected  from  both  the  existing  NCTM  as  well  as  the  CCSS 
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item  pools,  is  displayed  in  Table  2. 

Choosing  anchors  and  creating  pilot  forms.  A team  of  four  researchers  (including  the 
lead  researcher)  collaborated  to  select  the  anchor  items  from  the  NCTM  and  CCSS  pools  for 
pilot  forms.  One  of  the  researchers  had  a Ph.D.  in  Educational  Measurement  and  Evaluation, 
and  two  were  doctoral  students  in  the  University  of  Oregon’s  Educational  Methodology,  Policy, 
and  Leadership  program.  The  researcher  with  the  Ph.D.  and  both  doctoral  students  were  familiar 
with  the  math  item  development  and  items,  as  they  had  worked  with  the  lead  researcher  during 
item  writing  and  had  served  on  the  internal  item  review  team. 

As  mentioned  earlier,  anchor  items  for  the  current  piloting  were  selected  from  two 
different  item  pools  by  four  researchers.  Items  selected  from  the  K-5  NCTM  pool  had  been 
previously  piloted  and  scaled  (Alonzo  et  ah,  2009a,  2009b,  2009c;  Alonzo  & Tindal,  2009a, 
2009b;  Lai  et  ah,  2009),  and  thus,  item-level  information  was  available  to  guide  anchor  selection. 
Researchers  followed  a number  of  guidelines  when  selecting  anchor  items  from  the  NCTM  pool. 
Anchor  items  were  selected  to  balance  estimated  difficulty  across  all  1 5 pilot  forms  (easy, 
medium,  hard),  while  also  falling  within  the  acceptable  range  of  mean-square  outfit  values  (0.5 
to  1 .5)  recommended  for  reliable  measurement  in  high-stakes  multiple-choice  test  construction 
(Wright  & Linacre,  1994). 

A further  constraint  for  selection  of  anchor  items  from  the  NCTM  pool  was  that  they  be 
aligned  to  the  CCSS.  Based  on  results  from  Irvin  et  al.  (2012b)  and  Park  et  al.  (2012),  we  cross- 
walked  NCTM  Focal  Point  Standards  and  CCSS  that  were  associated  with  each  other  when 
NCTM-written  items  were  deemed  aligned  to  particular  CCSS  in  the  alignment  studies.  In  this 
manner,  items  originally  written  to  the  NCTM  Focal  Point  Standards,  though  not  necessarily 
included  in  the  2012  alignment  studies,  were  deemed  aligned  to  the  CCSS  and  included  in  the 
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pool  from  which  we  selected  anchor  items  in  the  current  study  (in  addition  to  those  items 
specifically  deemed  aligned  in  the  earlier  studies).  Lastly,  we  attempted  to  stratify  anchor  items 
selected  from  the  NCTM  pool  by  CCSS.  For  instance,  in  second  grade  there  are  4 different 
CCSS  domains  with  a total  of  37  unique  anchor  items  needed  to  populate  the  15  pilot  forms; 
thus,  9-10  items  were  selected  from  each  CCSS  domain  in  second  grade  and  stratified  across 
pilot  forms  as  evenly  as  possible. 

Empirically  estimated  item-level  information  was  not  available  for  items  in  the  new 
CCSS  pool;  thus,  it  was  impossible  to  know  the  difficulty  or  mean-square  outfit  of  items  in  the 
K-5  CCSS  pool  to  guide  anchor  selection.  Therefore,  we  adopted  the  same  anchor  item  selection 
process  used  in  our  previous  easyCBM  CCSS  middle  school  math  item  development  study  (see 
Anderson  et  ah,  2012,  p.  9 and  22),  whereby  our  team  of  four  researchers  worked  together  to 
select  appropriate  anchor  items  for  pilot  forms  based  on:  (a)  an  appropriate  number  of  steps 
required  to  respond  to  the  item  (typically  2-3),  (b)  minimal  language  requirements  outside  of  that 
needed  to  solve  the  math  problem,  (c)  culturally  unbiased  (e.g.,  a blend  of  diverse  names, 
avoiding  overrepresentation  of  subject  matter  unrelated  to  the  targeted  math  knowledge/skills), 
(d)  direct  alignment  to  targeted  CCSS,  and  (e)  consistency  with  principles  of  Universal  Design 
for  Assessment.  As  was  the  case  for  anchor  items  selected  from  the  NCTM  pool,  those  selected 
from  the  CCSS  pool  were  stratified  by  CCSS  domain  in  an  attempt  to  balance  representation 
within  and  across  each  grade-level  pilot  form. 

After  we  selected  horizontal  anchor  items,  we  created  1 5 pilot  forms  for  each  of  grades 
K-5.  For  all  grades,  the  first  4 items  of  each  pilot  fonn  were  unique  items  written  to  the  CCSS  as 
part  of  this  study.  The  next  10  items  (items  5-14)  of  each  form  were  horizontal  anchor  items. 

We  populated  items  5-9  with  anchor  items  selected  from  the  NCTM  pool,  and  items  10-14  with 
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anchor  items  selected  from  the  CCSS  pool.  For  both  bands  of  anchor  items  (5-9  and  10-14), 
either  2 or  3 items  linked  to  previous  or  the  following  pilot  forms  as  shown  in  Table  2.  It  should 
be  noted  that  pilot  forms  1 and  1 5 shared  either  2 or  3 horizontal  anchor  items  between  them, 
given  they  were  at  the  “ends”  of  the  line  of  forms  (i.e.,  form  15  served  as  the  “previous”  form  to 
form  1 and  vice  versa).  In  keeping  with  the  recommendations  of  Kolen  and  Brennan  (2004),  the 
placement  and  order  of  each  anchor  item  were  held  constant  on  a given  pilot  form.  Finally,  the 
unique  items  were  last:  items  15-32  for  grades  K-l,  and  15-41  for  grades  2-5.  All  unique  items 
were  stratified  within  and  across  pilot  forms  by  standard  and  domain  as  appropriate  and  possible 
to  balance  content  representation. 

Participant  recruiting  and  participation.  Over  the  winter  and  spring  of  2013,  teachers 
from  K-5  classrooms  were  recruited  to  participate  in  the  pilot  individually  and  at  the  district  level 
through  the  easyCBM  (http://www.easycbm.com)  and  BRT  websites  (http://www.brtproiects.org 
/about  /current-research),  and  through  existing  research  cooperative  relationships  around  the 
country.  To  protect  confidentiality,  districts,  schools  and  teachers  interested  in  participating 
were  informed  in  writing  that  identifying  information  (e.g.,  demographics)  would  not  be 
collected  on  students  or  teachers,  and  only  information  relevant  to  meeting  research  partnership 
status  would  be  collected  at  the  school  and  district  levels  (e.g.,  the  total  number  of  participating 
students  per  district  or  school).  At  the  same  time,  interested  participants  were  also  given  general 
details  concerning  the  piloting  process,  described  more  specifically  below,  to  make  clear  the 
study  requirements. 

A minimum  of  200  student  responses  per  item  is  desirable  to  obtain  stable  and  accurate 
item  calibrations  using  the  1 -parameter  logistic  Rasch  model  in  a concurrent  equating  design,  as 
was  used  in  the  current  study.  To  fulfill  this  minimum  response  requirement,  we  needed  to 
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recruit  3000  students  (15  forms  * 200  responses)  for  each  of  grades  K-5.  We  were,  however, 
constrained  by  the  end  of  the  academic  calendar  and  recruitment  resources,  and  thus,  we  did  not 
meet  the  minimum  desirable  response  requirements  for  each  form  (and  item).  In  total,  7,700 
students  and  329  teachers  from  140  schools,  in  132  districts,  across  33  states  participated  in  the 
piloting  portion  of  the  study  that  began  on  May  15,  2013  and  ended  on  June  15,  2013.  The 
following  number  of  students  participated  in  the  pilot  by  grade:  731  (grade  K),  1,124  (grade  1), 
1,136  (grade  2),  1,685  (grade  3),  1,499  (grade  4)  and  1,525  (grade  5).  Final  pilot  participation 
statistics  by  grade  and  fonn  are  given  in  Table  3. 

Piloting  process.  Once  they  agreed  to  participate,  teachers  were  given  detailed 
instructions  on  how  to  access  the  secure  piloting  website,  how  to  have  their  students  select  the 
appropriate  grade  level  (K-5),  and  how  their  students  would  begin  and  take  the  online  test. 
Students  were  instructed  to  use  scrap  paper  as  necessary,  but  not  to  use  calculators  to  complete 
any  math  items.  Once  students  selected  their  appropriate  grade,  they  were  shown  a title  screen 
that  prompted  them  to  begin  the  test  by  clicking  an  onscreen  button  when  ready.  Students  were 
then  immediately  administered  one  of  15  grade-level  pilot  forms.  The  administered  test  form 
was  automatically  assigned  by  the  piloting  website,  based  on  the  number  of  students  who  had 
completed  that  form  previously.  In  other  words,  students  were  assigned  the  grade-level  pilot 
form  with  the  fewest  number  of  completions  across  all  students  in  the  pilot.  Student  responses 
(a,  b,  or  c)  were  automatically  recorded  in  a secure  online  database  based  on  which  response 
option  a student  selected,  with  the  position  in  which  the  three  answer  options  (a,  b,  or  c)  were 
displayed  on  the  students’  computer  screens  randomized  each  time  an  item  was  administered. 
Given  that  pilot  forms  were  assigned  based  on  the  number  of  times  they  had  been  completed  and 
that  answer  options  were  randomly  rotated  each  time  an  item  was  administered,  cheating  was  a 
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limited  concern.  A screen  capture  of  a second  grade  math  item  demonstrative  of  how  all  items 
displayed  on  the  pilot  website  (and  indeed  the  K-8  easyCBM  formative  assessment  system)  is 
shown  in  Figure  1. 


Raul  went  on  a picnic  and  brought 
some  cupcakes,  sandwiches, 
carrots,  and  oranges. 

How  many  cupcakes  did  he  bring? 


© 


Figure  1.  Screen  capture  of  math  item  illustrating  online  display  of  math  items  in  the  pilot  study 
and  easyCBM  assessment  system. 

Item  calibration.  All  math  items,  including  those  from  the  larger  and  previously- 
existing  NCTM  pool,  were  calibrated  to  the  same  scale  using  a 1-parameter  logistic  (1PL)  Rasch 
model  in  a concurrent  equating  design  using  Winsteps  3.6.8  (Linacre,  2009).  In  the  Rasch 
model,  a special  case  of  the  1 -parameter  logistic  model  in  which  the  item  discrimination 
parameter  is  constrained  to  1.0  and  student  ability  is  freely  estimated  (Linacre,  2008),  all  item 
and  student  parameters  are  estimated  simultaneously  from  a single  data  file  that  contains  all 
student  responses,  grades  K-5.  The  concurrent  equating  design  estimates  student  ability  based 
on  their  responses  to  items,  treating  any  non-responses  as  missing.  Items  are  placed  on  the  same 
scale  through  the  inclusion  of  anchor  items  across  grade  level  forms,  displayed  in  Table  2. 
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The  Rasch  model  is  defined  as 


P(XLS 


H es,pd  = 


exp[(0s-Pj)] 

1 +exp[(9s-Pi)] 


(1) 


where: 

P = probability, 

Xts  = the  response  of  student  s to  math  item  i, 

6S  = the  estimated  ability  of  student  s,  and 

fit  = the  estimated  difficulty  of  math  item  i (DeMars,  2010). 

We  chose  the  more  parsimonious  1PL  Rasch  model  because  it  appears  to  fit  these  data 
well,  and  also  because  we  had  a large  final  item  bank  of  CCSS  math  items  (full  CCSS  item  bank) 
for  grades  K-5,  which  we  analyzed  for  functioning  and  used  to  construct  the  operational 
easyCBM  test  forms.  In  other  words,  we  had  a surplus  of  items  from  which  to  construct  test 
forms,  enabling  us  to  eliminate  those  items  that  did  not  function  well  from  the  full  CCSS  item 
bank. 


Test  form  creation.  Within  each  of  grades  K-5,  we  constructed  13  alternate  test  forms 
designed  to  be  of  comparable  difficulty  (3  to  be  used  as  seasonal  benchmark  screening  tests  and 
10  to  be  used  as  progress  monitoring  tests)  to  make  up  the  CCSS  Math  portion  of  the  easyCBM 
formative  assessment  system.  All  test  forms  consisted  of  items  that  appeared  to  function  well, 
while  counterbalancing  CCSS  domain  representation  within  and  across  each  grade  level  form  as 
possible.  To  construct  the  test  forms,  we  first  eliminated  all  items  from  the  full  CCSS  item  hank 
that  appeared  to  not  fit  the  1PL  Rasch  model  with  regard  to  estimated  mean  square  outfit. 

Wright  and  Linacre  (1994)  simulated  and  analyzed  hundreds  of  datasets,  recommending  that 
mean  square  outfit  values  between  0.5  and  1.5  could  be  interpreted  as  productive  for 
measurement  purposes  for  multiple-choice  test  construction,  with  values  >2.0  considered 
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degrading  to  the  measurement  system.  As  an  initial  step  in  test  form  construction,  we  thus 
eliminated  any  item  from  contention  that  had  mean  square  outfit  smaller  than  0.49  or  greater  than 
1.49. 

After  eliminating  such  items,  within  each  grade  we  sorted  the  remaining  items  in 
ascending  order  by  the  associated  CCSS  domain  and  the  estimated  difficulty  of  items  (easiest  to 
most  difficult).  Within  each  grade,  there  were  either  4 (grades  1 and  2)  or  5 (grades  K,  3-5) 
CCSS  domains  we  attempted  to  counterbalance  within  and  across  test  forms.  Thus,  we 
attempted  to  select  the  same  number  of  items  from  each  CCSS  domain  across  the  13  test  forms  at 
a given  grade  level,  though  this  was  not  possible  in  all  instances,  as  some  CCSS  domains  were 
underrepresented  relative  to  others.  To  accomplish  counterbalancing  CCSS  domain 
representation  while  maintaining  form  comparability,  we  selected  sets  of  13  items  of  roughly 
comparable  difficulty.  We  sought  a range  of  difficulty  between  these  selected  item  sets, 
including  items  with  “reach”  into  the  easier  end  of  the  difficulty  spectrum,  being  cognizant  that 
the  operational  tests  would  be  used  to  assess  diverse  student  populations,  from  both  the  special 
education  and  general  education  populations,  within  an  RTI  framework.  In  terms  of  the  layout 
of  selected  math  items  within  test  forms,  we  clustered  items  within  CCSS  domain,  and  then 
ordered  them  from  easiest  to  most  difficult.  We  reasoned  that  construct-irrelevant  variance 
would  likely  be  lessened  if  students  were  jumping  between  domains  less  often,  and  if  the  math 
skill  requirements  of  problems  “ramped  up”  from  lower-  to  higher-order  within  each  domain. 

The  final  step  in  the  test  fonn  creation  process  was  our  selection  of  horizontal  anchor 
items  between  grade  level  seasonal  benchmarks  to  allow  for  within-year  growth  estimation,  and 
vertical  anchors  between  seasonal  benchmarks  across  grades  as  a basis  for  constructing  a 
developmental  scale  score  after  the  2013-2014  academic  year.  The  same  team  of  four 
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researchers  who  selected  anchors  during  piloting,  selected  anchor  items  for  the  operational  test 
forms  using  the  same  process  and  guidelines  previously  described  because  they  were  intimately 
familiar  with  the  math  items  and  the  item/test  development  process. 

We  selected  horizontal  anchor  items  for  each  benchmark  using  a within- grade  linking 
design.  Within  each  grade,  5 horizontal  anchors  were  selected  to  link  the  fall  and  winter 
benchmarks,  and  5 to  link  the  winter  and  spring;  thus,  each  fall  and  spring  benchmark  test  form 
had  5 horizontal  anchor  items,  while  the  winter  test  had  10.  Horizontal  anchor  items  were 
selected  from  those  items  already  making  up  the  benchmark  tests  at  that  point  in  the  test  form 
creation  process.  At  this  point,  we  had  constructed  13  test  forms  designed  to  be  of  comparable 
difficulty  in  each  of  grades  K-5,  each  test  form  consisting  of  25  (grades  K-2)  or  30  (grades  3-5) 
math  items. 

We  then  selected  vertical  anchor  items  from  the  constructed  test  forms,  adding  5 (grade 
K)  or  10  (grades  1-5)  math  items  to  the  end  of  each  benchmark  test  in  a manner  that  linked 
adjacent  grade  level  benchmarks  of  the  same  season.  For  example,  we  selected  5 first  grade 
math  items  from  the  fall  benchmark  to  add  on  to  the  end  of  the  fall  Kindergarten  benchmark 
(linking  fall  grade  K to  fall  grade  1).  When  a grade  was  adjacent  to  two  other  grades  (i.e.,  grade 
3 is  adjacent  to  both  grades  2 and  4),  additional  vertical  anchors  were  appended  to  the  end  of  the 
seasonal  benchmark  test  forms.  For  example,  the  third  grade  fall  benchmark  included  5 vertical 
anchor  items  from  the  second  grade  fall  benchmark  and  5 items  from  the  fourth  grade  fall 
benchmark.  Within  each  test  form,  adjacent  grade-level  vertical  anchor  items  were  ordered  from 
easiest  to  most  difficult  based  on  the  estimated  difficulty  of  each  item  - the  same  manner  in 
which  unique  and  horizontal  anchor  items  were  ordered  with  respect  to  CCSS  domain  - and 
were  appended  to  the  end  of  each  seasonal  benchmark  in  the  order  of  subsequent  and  then  prior 


easyCBM  CCSS  Second  Grade  Math  Measure  Development 


17 


grade,  respectively.  This  pattern  of  vertical  anchor  linking  prior  and  adjacent  grades  continued 
for  all  seasonal  benchmarks  for  each  of  grades  K-5  (and  also  grades  6-8,  though  those  results  are 
not  included  in  this  series  of  technical  reports).  Student  responses  to  vertical  anchor  items  over 
the  2013-2014  academic  year  will  serve  as  the  basis  for  constructing  a cross-grade 
developmental  scale  as  we  move  toward  the  reporting  of  a scale  score  in  future  years. 

Results 

As  a result  of  item  development  and  test  creation  efforts  described  in  this  study,  we 
constructed  13  alternate  test  forms:  3 designated  for  seasonal  benchmarking  and  10  designated 
for  progress  monitoring,  in  each  of  grades  K-5.  We  designed  the  test  forms  to  be  aligned  with 
the  CCSS  in  mathematics,  to  be  of  comparable  difficulty  within  grade,  and  to  be  accessible  for 
diverse  student  populations  with  a wide  range  of  achievement.  We  loaded  K-5  tests  into  the 
easyCBM  database  for  use  as  online  formative  CCSS  math  assessments  and  released  them  for 
use  in  fall  2013. 

The  results  of  our  analyses  are  reported  separately  by  grade  (K-5),  each  in  its  own 
technical  report.  For  second  grade,  each  seasonal  benchmark  consists  of  35  total  math  items, 
including  5 vertical  anchor  items  linked  to  each  of  the  respective  grade  1 and  grade  3 
benchmarks.  Each  progress-monitoring  test  form  consists  of  25  unique  math  items.  The  item 
difficulties  for  each  of  the  13  second  grade  test  forms  are  displayed  in  Table  4. 

Item  Statistics 

We  present  the  results  of  the  1PL  Rasch  analysis  in  ascending  order  by  test  form  and  for 
the  full  CCSS  second  grade  item  bank  in  Appendices  B and  D,  respectively.  When  examining 
item  information  in  these  appendices,  it  is  important  to  highlight  two  statistics  critical  to 
evaluating  item  functioning  within  the  context  of  Rasch-based  test  development:  the  estimated 
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difficulty  and  indicator  of  discrimination.  The  difficulty  parameter,  /?,  in  equation  1,  represents 
the  estimation  of  how  difficult  item  i is  relative  to  all  other  items  in  the  analytic  sample,  with 
approximate  possible  values  ranging  from  -3  (easiest  items)  to  +3  (most  difficult  items)  in  the 
standardized  scale  - the  same  scale  on  which  student  ability  (0S)  is  reported  (DeMars,  2010).  An 
estimated  difficulty  equal  to  0 could  then  be  interpreted  as  a student  with  average  ability  would 
have  an  equal  probability  of  getting  the  answer  correct  as  incorrect.  Individual  item  difficulties 
are  averaged  across  forms,  representing  an  average  difficulty  of  each  test  fonn  as  displayed  in 
Table  4,  to  evaluate  form  equivalence.  The  average  difficulty  across  all  13  second  grade  test 
forms  is  -0.080  (range  = -0.129  to  -0.049),  or  slightly  below  average  difficulty.  The  second 
statistic  that  warrants  highlighting  is  the  indicator  of  item  discrimination.  As  noted  earlier,  the 
1PL  Rasch  analysis  constrains  the  discrimination  parameter  to  1.0  (DeMars,  2010;  Linacre, 
2008).  Though  discrimination  statistics  are  included  for  each  item  in  Appendices  B and  D,  it  is 
important  to  distinguish  that  this  item  statistic  is  not  a true  estimation  of  item  discrimination,  but 
rather  an  rough  indicator  o/item  discrimination,  approximated  during  a post-hoc  calculation  by 
WINSTEPS  (Linacre,  2008).  Interpretation  of  discrimination  values  in  1PL  Rasch  analysis  is  the 
same  as  those  freely  estimated  in,  for  example,  a 2-parameter  logistic  model;  though,  caution  is 
warranted  given  they  are  merely  rough  indicators  in  this  study.  Discrimination  values  >1.2  are 
considered  very  high  (more  productive  for  measurement  purposes),  while  values  < 0.5  are 
considered  very  low,  when  item  difficulty  and  student  ability  are  estimated  in  the  standardized 
scale  (DeMars,  2010),  as  is  the  case  in  our  analysis. 

Distractor  Analysis 

We  present  response  option  statistics  in  ascending  order  by  test  form  and  for  the  full 
CCSS  second  grade  item  bank  in  Appendices  C and  E,  respectively.  Interpretation  of  statistics 


19 

easyCBM  CCSS  Second  Grade  Math  Measure  Development 

within  these  appendices  is  similar  to  item  level  interpretation,  but  is  presented  for  each  of  the 
three  response  options.  We  coded  the  correct  response  option  as  A for  all  items,  while  the  * 
represents  missing  data  (those  students  included  in  the  analytic  sample  who  did  not  respond  to 
the  given  item  either  by  choice,  if  administered  the  pilot  fonn  containing  the  item,  or  simply 
because  they  were  not  administered  that  form).  We  analyzed  distractors,  seeking  to  retain  well- 
functioning items  in  which  students  with  the  highest  average  estimated  ability  selected  the 
correct  answer  choice,  thus  demonstrating  the  highest  average  person  measure,  while  students 
with  lower  average  estimated  ability  selected  one  of  the  remaining  answer  options.  As  described 
earlier,  we  attempted  to  write  items  with  one  near  distractor  and  one  far  distractor.  Items 
functioning  well  would  thus  demonstrate  near  distractors  with  average  person  measure  values 
slightly  below  that  of  the  correct  response  option  and  far  distractors  with  lower  average  person 
measure  values. 

Discussion 

As  instruction  in  public  schools  across  the  United  States  moves  in  closer  alignment  with 
the  CCSS,  it  is  important  for  formative  student  assessment  to  also  move  in  that  direction  given 
that  the  results  of  such  assessment  are  regularly  used  to  inform  instructional  decision-making 
within  RTI  contexts.  To  a growing  degree,  the  validity  of  instructional  decision-making  in  these 
contexts  depends  on  both  the  alignment  between  adopted  fonnative  assessments  and  the  CCSS 
and  also  the  technical  adequacy  of  such  assessments.  In  this  series  of  technical  reports,  we 
described  the  development  and  scaling  of  the  easyCBM  CCSS  Math  assessments  for  grades  K-5, 
designed  for  use  within  an  RTI  framework  of  instruction  and  formative  assessment  in  elementary 


classrooms. 
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Table  1 


Second  Grade  Item  Writing  Plan  by  CCSS  Standard 


CCSS  Standard 

Item  Set  1 

Item  Set  2 

Item  Set  3 

Item  Set  4 

Existing 
BM  Align 

Total 

G1 

10 

10 

11 

11 

0 

42 

G2 

10 

11 

10 

10 

3 

41 

G3 

11 

11 

10 

10 

0 

42 

MD1 

0 

0 

0 

0 

7 

0 

MD2 

3 

3 

3 

3 

3 

12 

MD3 

4 

3 

4 

4 

0 

15 

MD4 

3 

4 

4 

4 

0 

15 

MD5 

4 

4 

4 

3 

0 

15 

MD6 

3 

3 

3 

4 

2 

13 

MD7 

3 

3 

3 

3 

3 

12 

MD8 

4 

3 

3 

3 

2 

13 

MD9 

3 

4 

4 

4 

0 

15 

MD10 

4 

4 

4 

3 

0 

15 

NBT1 

0 

0 

0 

0 

10 

0 

NBT2 

5 

5 

5 

5 

0 

20 

NBT3 

5 

5 

5 

5 

0 

20 

NBT4 

0 

0 

0 

0 

7 

0 

NBT5 

1 

1 

1 

2 

5 

5 

NBT6 

5 

5 

5 

5 

0 

20 

NBT7 

5 

5 

5 

5 

2 

20 

NBT8 

5 

5 

5 

5 

2 

20 

NBT9 

5 

5 

5 

5 

0 

20 

OA1 

2 

1 

1 

1 

7 

5 

OA2 

10 

10 

10 

10 

3 

40 

OA3 

10 

10 

10 

10 

0 

40 

OA4 

10 

10 

10 

10 

1 

40 

Set  total 

125 

125 

125 

125 

57 

500 

Note.  Item  Sets  1-4  reflect  items  written  to  each  CCSS  standard  based  on  results  from  our 
previous  alignment  study  (Irvin  et  al.,  2012b),  reflected  in  Existing  BM  Align  column.  Total 
represents  the  number  of  math  items  written  to  a given  CCSS  standard  in  the  current  study. 
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Table  2 


Grades  K-2  Piloting  Plan 


Form 

Cl 

C2 

C3 

C4 

C5 

C6 

C7 

C8 

C9 

CIO 

Cll 

C12 

C13 

C14 

C15 

Anchor 

Unique 

Total 

1 

5 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

5 

22 

32 

2 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

3 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

4 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

5 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

6 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

7 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

8 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

9 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

3 

22 

32 

10 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

2 

22 

32 

11 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

3 

22 

32 

12 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

2 

22 

32 

13 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

3 

22 

32 

14 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

2 

22 

32 

15 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

0 

22 

32 

Form 

N1 

N2 

N3 

N4 

N5 

N6 

N7 

N8 

N9 

N10 

Nil 

N12 

N13 

N14 

N15 

Anchor 

Unique 

Total 

1 

5 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

5 

22 

32 

2 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

3 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

4 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

5 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

6 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

7 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

8 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

9 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

2 

22 

32 

10 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

3 

22 

32 

11 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

2 

22 

32 

12 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

3 

22 

32 

13 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

2 

22 

32 

14 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

3 

22 

32 

15 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

0 

22 

32 

Note.  C = CCSS  pool  anchor  item;  N = NCTM  pool  anchor  item.  Anchor  items  appearing  in  a vertical  column  (both  CCSS  or 
NCTM)  were  shared  between  the  specified  forms.  For  example,  fonn  3 and  form  4 shared  3 anchor  items  from  the  CCSS  pool  (set 
C3)  and  2 from  the  NCTM  pool  (set  N3). 
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Table  3 


Grades  K-5  Piloting  Participation  Statistics 


Grade  K 

Grade  1 

Grade  2 

Form 

Completed 

Form 

Completed 

Form 

Completed 

1 

48 

55 

1 

77 

84 

1 

97 

110 

2 

48 

51 

2 

70 

79 

2 

72 

251 

3 

50 

57 

3 

78 

102 

3 

85 

96 

4 

49 

56 

4 

87 

114 

4 

69 

76 

5 

48 

52 

5 

70 

77 

5 

66 

78 

6 

48 

52 

6 

70 

85 

6 

66 

78 

7 

48 

52 

7 

73 

82 

7 

66 

73 

8 

50 

52 

8 

72 

93 

8 

70 

80 

9 

50 

55 

9 

76 

85 

9 

89 

95 

10 

48 

51 

10 

73 

86 

10 

79 

88 

11 

52 

81 

11 

73 

87 

11 

75 

85 

12 

48 

54 

12 

86 

89 

12 

80 

104 

13 

47 

58 

13 

80 

99 

13 

69 

82 

14 

49 

70 

14 

70 

116 

14 

84 

85 

15 

48 

52 

15 

69 

77 

15 

69 

71 

Form  Average 

49 

57 

Form  Average 

75 

90 

Form  Average 

76 

97 

Grade  3 

Grade  4 

Grade  5 

Form 

Completed 

Form 

Completed 

Form 

Completed 

1 

107 

250 

1 

104 

118 

1 

97 

135 

2 

107 

197 

2 

94 

112 

2 

110 

132 

3 

114 

128 

3 

89 

101 

3 

99 

123 

4 

118 

159 

4 

103 

115 

4 

95 

143 

5 

122 

139 

5 

119 

141 

5 

93 

102 

6 

114 

128 

6 

89 

95 

6 

99 

156 

7 

122 

146 

7 

91 

103 

7 

97 

110 

8 

110 

266 

8 

91 

111 

8 

118 

152 

9 

106 

115 

9 

104 

121 

9 

116 

133 

10 

106 

123 

10 

110 

118 

10 

103 

128 

11 

109 

116 

11 

89 

104 

11 

93 

113 

12 

119 

146 

12 

89 

118 

12 

100 

142 

13 

109 

170 

13 

103 

110 

13 

100 

121 

14 

116 

192 

14 

108 

232 

14 

111 

139 

15 

106 

136 

15 

116 

138 

15 

94 

105 

Form  Average 

112 

161 

Form  Average 

100 

122 

Form  Average 

102 

129 

Note.  Many  test  forms  were  started  though  not  completed,  thus,  the  number  of  student  responses  per  item  varies  within  form,  as  shown  in  Appendices  B and  D. 
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Table  4 


Second  Grade  Item  Difficulties  by  Test  Form 


Item  # 

Test  Form 

Mean 

PM1 

PM2 

PM3 

PM4 

PM5 

PM6 

PM7 

PM8 

PM9 

PM  10 

BMF 

BMW 

BMS 

1 

-1.65 

-1.63 

-1.63 

-1.54 

-1.47 

-1.51 

-1.51 

-1.54 

-1.46 

-1.44 

-1.68 

-1.68 

-1.66 

-1.569 

2 

-1.12 

-1.13 

-1.16 

-1.16 

-1.18 

-1.18 

-1.22 

-1.26 

-1.22 

-1.31 

-0.98 

-1.01 

-1.02 

-1.150 

3 

0.54 

0.29 

0.58 

0.28 

0.74 

0.58 

0.67 

0.32 

0.29 

0.62 

0.45 

0.45 

0.43 

0.480 

4 

-0.96 

-0.91 

-0.90 

-0.90 

-1.03 

-1.01 

-1.01 

-0.99 

-0.97 

-0.96 

-0.95 

-0.95 

-0.95 

-0.961 

5 

-0.54 

-0.56 

-0.56 

-0.57 

-0.59 

-0.58 

-0.53 

-0.52 

-0.52 

-0.59 

-0.53 

-0.53 

-0.53 

-0.550 

6 

-0.47 

-0.47 

-0.47 

-0.45 

-0.44 

-0.44 

-0.44 

-0.43 

-0.43 

-0.42 

-0.47 

-0.47 

-0.47 

-0.452 

7 

-0.21 

-0.19 

-0.20 

-0.18 

-0.20 

-0.18 

-0.19 

-0.17 

-0.19 

-0.17 

-0.17 

-0.17 

-0.17 

-0.184 

8 

0.15 

0.13 

0.15 

0.12 

0.15 

0.12 

0.14 

0.11 

0.14 

0.10 

0.10 

0.10 

0.10 

0.124 

9 

0.91 

0.90 

0.93 

0.95 

0.95 

0.96 

0.97 

0.98 

0.99 

0.90 

0.92 

0.92 

0.92 

0.938 

10 

1.46 

1.45 

1.47 

1.43 

1.47 

1.40 

1.49 

1.40 

1.51 

1.50 

1.45 

1.45 

1.45 

1.456 

11 

-1.31 

-1.31 

-1.31 

-1.31 

-1.31 

-1.33 

-1.37 

-1.38 

-1.38 

-1.39 

-1.32 

-1.32 

-1.32 

-1.335 

12 

-1.00 

-1.00 

-0.98 

-0.98 

-0.97 

-0.97 

-1.00 

-1.00 

-0.98 

-0.98 

-1.00 

-1.00 

-1.00 

-0.989 

13 

-0.76 

-0.75 

-0.75 

-0.75 

-0.77 

-0.77 

-0.78 

-0.78 

-0.78 

-0.78 

-0.76 

-0.76 

-0.76 

-0.765 

14 

-0.61 

-0.65 

-0.60 

-0.65 

-0.60 

-0.65 

-0.59 

-0.66 

-0.66 

-0.66 

-0.61 

-0.61 

-0.61 

-0.628 

15 

0.04 

0.04 

0.04 

0.04 

0.04 

0.04 

0.05 

0.04 

0.05 

0.06 

0.04 

0.04 

0.04 

0.043 

16 

0.61 

0.64 

0.63 

0.66 

0.72 

0.70 

0.72 

0.80 

0.81 

0.80 

0.76 

0.76 

0.76 

0.721 

17 

1.81 

1.78 

1.77 

1.75 

1.74 

1.73 

1.72 

1.70 

1.69 

1.68 

1.67 

1.67 

1.67 

1.722 

18 

-0.64 

-0.63 

-0.62 

-0.60 

-0.59 

-0.60 

-0.60 

-0.63 

-0.64 

-0.64 

-0.64 

-0.64 

-0.64 

-0.624 

19 

-0.38 

-0.38 

-0.39 

-0.43 

-0.39 

-0.42 

-0.42 

-0.43 

-0.43 

-0.43 

-0.36 

-0.36 

-0.36 

-0.398 

20 

-0.11 

-0.12 

-0.12 

-0.13 

-0.13 

-0.13 

-0.12 

-0.12 

-0.11 

-0.11 

-0.10 

-0.10 

-0.10 

-0.115 

21 

0.02 

0.02 

0.02 

0.02 

0.05 

0.04 

0.04 

0.05 

0.04 

0.04 

0.05 

0.05 

0.05 

0.038 

22 

0.17 

0.17 

0.22 

0.19 

0.19 

0.19 

0.20 

0.20 

0.21 

0.21 

0.18 

0.18 

0.18 

0.192 

23 

0.31 

0.29 

0.35 

0.29 

0.33 

0.30 

0.32 

0.30 

0.31 

0.31 

0.35 

0.35 

0.35 

0.320 

24 

0.65 

0.61 

0.61 

0.61 

0.62 

0.64 

0.65 

0.60 

0.60 

0.60 

0.62 

0.62 

0.62 

0.619 

25 

1.57 

1.52 

1.46 

1.44 

1.44 

1.41 

1.41 

1.40 

1.40 

1.60 

1.56 

1.56 

1.56 

1.487 

Mean 

-0.061 

-0.076 

-0.058 

-0.075 

-0.049 

-0.066 

-0.056 

-0.080 

-0.069 

-0.058 

-0.129 

-0.129 

-0.129 

-0.080 

Note.  PM1  to  PM10  = Progress  Monitoring  Form  1 to  Form  10;  BMF  = Benchmark  Fall,  BMW  = Benchmark  Winter,  BMS  = Benchmark  Spring; 
Green  = horizontal  anchor  items. 
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Appendix  A:  Training 


Appendix  A:  Training  Materials 
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Appendix  A:  Training 


Common  Core  State  Standards  (CCSS) 
Math  Item  Writing  and  Review 

Supplementing  the  easyCBM  math 
assessment  system 


easyCBM 

• easyCBM  is  an  online  benchmark  and  progress 
monitoring  assessment  system. 

• Designed  to  inform  teachers'  classroom-based 
instructional  decisions 

• Used  within  Response  to  Intervention  (RTI) 


easyCBM  CCSS  Second  Grade  Math  Measure  Development 


30 

Appendix  A:  Training 


easyCBM  in  Use 

• What  are  your  experiences  with  easyCBM? 

Popularity  of  the  System 

• Registered  users  in  all  50  states 

• Over  2 million  students  in  the  system 

• Over  800,000  teachers  in  the  system 

• Growing  exponentially 

• Over  9000  new  registered  teacher  users  every 
month;  with  district-level  subscribers  growing 


Within  RTI  (very  general) 


Standards,  instruction  and  assessment  must  align 
for  accurate  decision-making  and  inferences! 
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Item 


Before  we  get  too  far: 
Vocabulary 


(Question) 

Stem 


Project  Overview 

• Develop  3,000  new  math  items  for  easyCBM 
in  grades  K-5;  500  items  per  grade 

- Aligned  with  the  Common  Core  State  Standards 
(CCSS) 

- Piloted  in  April/May  to  examine  their  technical 
adequacy  and  establish  difficulty 

— Developed  items  will  be  assembled  with  existing 
items  that  were  aligned  to  CCSS  into  20  test  forms 
per  grade  (60  forms  total). 

- Each  form  will  have  25  items  for  use  in  easyCBM 

- Anticipated  release  date  of  Fall  2013 
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Appendix  A:  Training 


Existing  Items  vs.  Items  to  be  Developed 

Existing  Items 

Items  to  be  Developed 

• Originally  developed  for  the 

• Should  be  developed  for 

2%  population  (i.e., 

students  performing  at  or 

students  performing  well 

slightly  below  grade-level 

below  grade-level 

expectations. 

expectations) 

• Aligned  to  the  NCTM  Focal 
Point  Standards 

• Aligned  to  the  CCSS 

Common  Core  Standards  (see  PDF) 

Grade  K 

Standard  Domains 

• Counting  and  Cardinality  (KCC) 

• Operations  and  Algebraic  Thinking  (KOA) 

• Number  and  Operations  in  Base  Ten  (KNBT) 

• Measurement  and  Data  (KMD) 

• Geometry  (KG) 

24  standards  divided  among  5 domains. 
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Appendix  A:  Training 


Outline  of  GrK  Items  to  be  Written/Reviewed 


Item  Set  2 

Item  Set  3 

Item  Set  4 

Item  Set  5 

CCSS  B M Alien 

Total 

CCl 

5 

5 

6 

6 

0 

22 

CC2 

1 

1 

1 

1 

6 

4 

CC3 

6 

6 

5 

5 

1 

22 

CC4 

1 

1 

1 

1 

5 

4 

CCS 

5 

5 

6 

6 

3 

22 

CC6 

1 

1 

1 

1 

5 

4 

CC7 

6 

6 

5 

5 

2 

22 

SI 

1 

1 

1 

1 

6 

4 

G2 

1 

1 

1 

1 

7 

4 

S3 

10 

10 

11 

11 

2 

42 

G4 

1 

1 

1 

1 

5 

4 

G5 

11 

11 

10 

10 

0 

42 

G6 

1 

1 

1 

1 

8 

4 

MD1 

4 

4 

4 

4 

5 

16 

MD2 

2 

2 

2 

2 

9 

8 

MD3 

19 

19 

19 

19 

4 

76 

NBT1 

25 

25 

25 

25 

1 

100 

DAI 

5 

5 

5 

5 

3 

20 

DA2 

5 

5 

5 

5 

3 

20 

0A3 

5 

5 

5 

5 

0 

20 

OA4 

5 

5 

5 

5 

1 

20 

OA5 

5 

5 

5 

5 

3 

20 

Set  Total 

125 

125 

125 

125 

500 

Common  Core  Standards  (see  PDF) 

Grade  1 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (10A) 

• Number  and  Operations  in  Base  Ten  (1NBT) 

• Measurement  and  Data  (1MD) 

• Geometry  (1G) 


21  standards  divided  among  4 domains. 
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Outline  of  Grl  Items  to  be  Written/Reviewed 


hem  Set  2 

hem  Set  3 

hem  Set  4 

hem  Set  5 

CCSS  B M Alien 

Total 

61 

10 

10 

10 

10 

4 

40 

62 

10 

10 

10 

10 

63 

12 

11 

11 

11 

1 

45 

MD1 

8 

8 

8 

8 

1 

32 

MD2 

8 

8 

8 

8 

0 

32 

MD3 

8 

8 

8 

8 

0 

32 

MM 

7 

7 

7 

8 

3 

29 

NBT2 

1 

2 

1 

1 

5 

5 

NBT3 

10 

10 

10 

10 

2 

40 

NBT3 

10 

10 

10 

10 

0 

40 

NBT6 

10 

10 

10 

10 

0 

40 

OA2 

6 

6 

7 

6 

4 

25 

044 

6 

6 

6 

7 

1 

25 

0A3 

6 

7 

6 

6 

1 

25 

0A7 

6 

6 

7 

6 

0 

25 

0A8 

7 

6 

6 

6 

3 

25 

Set  Total 

125 

125 

125 

125 

500 

Common  Core  Standards  (see  PDF) 

Grade  2 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (20A) 

• Number  and  Operations  in  Base  Ten  (2NBT) 

• Measurement  and  Data  (2MD) 

• Geometry  (2G) 


26  standards  divided  among  4 domains. 
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Outline  of  Gr2  Items  to  be  Written/Reviewed 

hem  Set  2 

Item  Set  3 

Hem  Set  4 

hem  Set  5 

CCSS  BM  Alien 

Total 

si 

10 

10 

11 

11 

0 

42 

G2 

10 

11 

10 

10 

3 

41 

S3 

11 

11 

10 

10 

0 

42 

MD2 

3 

3 

3 

3 

3 

12 

MD3 

4 

3 

4 

4 

0 

15 

MD4 

3 

4 

4 

4 

0 

15 

WD5 

4 

4 

4 

3 

0 

15 

MD6 

3 

3 

3 

4 

2 

13 

>4  07 

3 

3 

3 

3 

3 

12 

MD8 

4 

3 

3 

3 

2 

13 

MD9 

3 

4 

4 

4 

0 

15 

MD10 

4 

4 

4 

3 

0 

15 

NBT2 

5 

5 

5 

5 

0 

20 

•4BT3 

5 

5 

5 

5 

0 

20 

NBT5 

1 

1 

1 

2 

5 

5 

NBT6 

5 

5 

5 

5 

0 

20 

NBT7 

5 

5 

5 

5 

2 

20 

NBT8 

5 

5 

5 

5 

2 

20 

NBT9 

5 

5 

5 

5 

0 

20 

DAI 

2 

1 

1 

1 

7 

5 

0A2 

10 

10 

10 

10 

3 

40 

OA3 

10 

10 

10 

10 

0 

40 

OA4 

10 

10 

10 

10 

1 

40 

125 

125 

125 

125 

500 

Common  Core  Standards  (see  PDF) 

Grade  3 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (30A) 

• Number  and  Operations  in  Base  Ten  (3NBT) 

• Number  and  Operations-Fractions  (3NF) 

• Measurement  and  Data  (3MD) 

• Geometry  (3G) 

25  standards  divided  among  5 domains. 
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Appendix  A:  Training 


Outline  of  Gr3  Items  to  be  Written/Reviewed 


Item  Set  2 

Item  Set  3 

Item  Set  4 

Item  Set  5 

CCSS  BM  Alien 

Total 

OAl 

5 

5 

5 

5 

3 

20 

OA4 

5 

5 

5 

5 

4 

20 

OA5 

5 

5 

5 

5 

2 

20 

OA6 

5 

5 

5 

5 

3 

20 

OA8 

5 

5 

5 

5 

3 

20 

NBT1 

8 

9 

9 

8 

0 

34 

NBT2 

9 

8 

8 

8 

0 

33 

NBT3 

8 

8 

8 

9 

1 

33 

NF2 

20 

20 

20 

20 

1 

SO 

NF3 

5 

5 

5 

5 

5 

20 

MD1 

3 

3 

3 

4 

0 

13 

MD2 

4 

3 

3 

3 

0 

13 

MD3 

3 

3 

4 

3 

0 

13 

MD4 

3 

4 

3 

3 

0 

13 

MD5 

3 

3 

3 

3 

0 

12 

MD6 

3 

3 

3 

3 

1 

12 

MD7 

3 

3 

3 

3 

0 

12 

MDfi 

3 

3 

3 

3 

1 

12 

G1 

20 

20 

20 

20 

4 

SO 

62 

5 

5 

5 

5 

15 

20 

125 

125 

125 

125 

500 

Common  Core  Standards  (see  PDF) 

Grade  4 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (40A) 

• Number  and  Operations  in  Base  Ten  (4NBT) 

• Number  and  Operations-Fractions  (4NF) 

• Measurement  and  Data  (4MD) 

• Geometry  (4G) 

28  standards  divided  among  5 domains. 
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Appendix  A:  Training 


Outline  of  Gr4  Items  to  be  Written/Reviewed 


Common  Core  Standards  (see  PDF) 

Grade  5 

Standard  Domains 

• Operations  and  Algebraic  Thinking  (50A) 

• Number  and  Operations  in  Base  Ten  (5NBT) 

• Number  and  Operations-Fractions  (5NF) 

• Measurement  and  Data  (5MD) 

• Geometry  (5G) 

26  standards  divided  among  5 domains. 
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Appendix  A:  Training 


Outline  of  Gr5  Items  to  be  Written/Reviewed 


Item  Set  2 

Hem  Set  3 

Hem  Set  4 

Item  Set  5 

CCSS  BM  Alien 

Total 

OAl 

9 

9 

8 

8 

1 

34 

OA2 

8 

8 

8 

9 

0 

33 

0A3 

8 

8 

9 

8 

0 

33 

NBT1 

3 

4 

4 

4 

2 

15 

NBT2 

4 

4 

4 

3 

2 

15 

NBT3 

5 

5 

5 

5 

0 

20 

NBT4 

4 

3 

4 

4 

2 

15 

NBT5 

5 

5 

5 

5 

0 

20 

NBT6 

4 

4 

3 

4 

3 

15 

NF2 

3 

4 

4 

4 

2 

15 

NF3 

5 

5 

5 

5 

0 

20 

NF4 

4 

4 

4 

3 

1 

15 

KF5 

S 

5 

5 

5 

0 

20 

f»F6 

4 

4 

3 

4 

1 

15 

NF7 

4 

3 

4 

4 

2 

15 

MD1 

7 

7 

8 

8 

0 

30 

M02 

8 

8 

7 

7 

0 

30 

M04 

5 

5 

5 

5 

3 

20 

M05 

S 

5 

5 

5 

4 

20 

G1 

7 

6 

6 

6 

0 

25 

G2 

6 

6 

6 

7 

0 

25 

G3 

6 

6 

7 

6 

0 

25 

G4 

6 

7 

6 

6 

0 

25 

125 

125 

125 

125 

500 

Why  So  Many  New  Items? 

1.  No  matter  how  perfect  an  item  looks,  there 
are  always  quirks. 

- We  need  250-300  "good"  items  per  grade. 

- If  we  write  500  items  per  grade,  we  can  "weed 
out"  the  poor  items. 

2.  The  surplus  of  items  also  allows  us  to 
assemble  items  into  test  forms  (i.e.,  seasonal 
benchmarks  and  progress-monitoring)  of 
comparable  difficulty. 


easyCBM  CCSS  Second  Grade  Math  Measure  Development 


39 

Appendix  A:  Training 


Purpose  1 

Example:  Two  Similar  Items 

Item  1 Item  2 


A. 

6 

15 

A.  4 

B. 

8 

p 

B*  18 

C. 

JL 

r, 

C.  1 

Purpose  1 

Example  (continued) 

• Although  the  previous  two  items  look  very 
similar,  our  statistical  analyses  of  the  items 
functioning  indicate  that  Item  1 is  functioning 
quite  well,  while  Item  2 is  functioning  quite 
poorly. 

• Item  2 was  determined  to  be  functioning  poorly 
enough  that  it  was  removed 

• Despite  the  similarities  in  item  construction,  the 
students'  responses  to  the  items  are  very 
different  (i.e.,  matching  student  ability  w/ 
question  difficulty). 
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Appendix  A:  Training 


Purpose  1 
Recap 

Item  1 Item  2 


i*i  = _ 


a.  -Hr  a-  7 

b. {  Good  Item  B -w  Poor  Item 

Why?  It's  difficult  to  say  for  sure,  but  is  part  of  why  we  need  to  write  a 
surplus  of  items 


Purpose  2 
RTI 

• RTI  requires  multiple  test  forms  of  equivalent 
difficulty 

• If  forms  are  not  equivalently  difficult, 
assumptions  about  the  growth  students  make 
and/or  the  effectiveness  of  instruction  or  an 
intervention  may  not  be  accurate 
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Appendix  A:  Training 


Purpose  2 
(Continued) 

• Growth? 

- What  if  first  three 
forms  were  unusually 
difficult  and  the  last 
two  forms  were 
unusually  easy? 

• We  need  to  have  a sufficient  number  of  items 
to  ensure  that  forms  actually  are,  statistically 
speaking,  equivalently  difficult. 


G*«d«  1.  Wo  id  H« ini|  FluMicy:  Jufa  Aton?® 


(•M  Grea* 

£ ifl 

.u,_ • 

• 

sa  - 

/ / s 

D«ta  of  AnainiliHtM 

Or»il  30  mnQmr  on  awcutor 


10PB  • '30PB  SOpb  90p* 


Your  Role  As  the  Item  Writer  and 
Item  Reviewer 

A Concurrent  Process  of  Item 
Writing , Reviewing , and  Submission 
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Appendix  A:  Training 


Your  role  as  the  Item  Writer 

• Become  an  "item  writing  expert" 

- Thoroughly  review  the  CCSS  associated  with  the 
grade-band  you  have  been  assigned  (i.e.,  K-l,  2-3, 
and  4-5). 

- Review  "example  items"  in  ItemSet  spreadsheet. 

• Complete  two  ItemSet  spreadsheets, 
consisting  of  125  items  for  each  grade  of  your 
assigned  grade  band  (i.e.,  125  grade  K items, 
and  125  grade  1 items  for  K-l  grade  band) 

• Thoroughly  review  all  items  written  before 
turning  items  in  to  BRT  (in  batches). 


Your  role  as  the  Item  Reviewer 

• Become  an  "item  writing  expert" 

- Thoroughly  review  the  CCSS  associated  with  the 
grade  that  you  have  been  assigned  (i.e.,  K,  1,  2,  3, 
4,  or  5). 

- Review  "example  items"  in  ItemSet  spreadsheet. 

• Review  and  edit  500  grade-level  items  from 
the  4 ItemSets  (in  batches). 

• Thoroughly  review  all  items  written  before 
turning  items  in  to  BRT  (in  batches,  by 
ItemSet). 
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Excel  ItemSet  Template  cont. 

• Each  ItemSet  consists  of  125  items 

• Item  Writers  will  write  all  125  items  and  fill  out  the 
excel  sheet. 

- After  writing  items  into  the  excel  file,  the  Item  Writer 
should  add  an  underscore  and  their  initials  after  the 
version  number  to  save  it 

• e.g.,  Item  Writer  = Shawn  Irvin: 

G2ltemSet2.xlsx  G2ltemSet2_Sl.xlsx 

• Each  Item  Writer  will  write  items  to  specific  CCSS, 
most  times  multiple  items  per  standard 

• The  number  of  items  per  domain  will  vary  by  Item 
Writer  and  grade. 


Excel  ItemSet  Template 


•rtnv  ■■«!*  f"*  (Mfr  i* r*«i  i*  id'r  ?frtr 


.. Kli-iv1  IhiKi"  Hhtn1  MMn  Mlfim'  ***.*?,  V !! 


emt  •»«»  j wtn»r  o. 


Sir- 


Write  one  Question  (stem)  and  three 

Answer  options  in  these  cells 

• Option  A is  always  the  correct 
answer 

• Options  B and  C are  always 
incorrect,  but  plausible  distractor 
responses 


The  "home"  for  all  of  the  items  we  write  and  review!!! 
These  ItemSet  spreadsheets  will  be  passed  from  Writers  to 
me  to  Reviewers  and  back  to  me  for  an  in-house  review. 
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Appendix  A:  Training 


Item  ID  Naming  Convention 

• It  is  crucial  that  all  items  written  are  filled  out 
in  the  excel  sheet  appropriately 

• Graphics  accompanying  an  item  MUST  BE 
given  the  same  ID  because  the  graphic  is  part 
of  the  item. 

- If  the  wrong  ID  is  assigned  to  the  graphic,  it  will 
either  be  lost  or  accompany  the  wrong  item. 
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Graphics  (images)  in  Items 

• First  rule  of  graphics  - they  are  expensive 

- Adds,  on  average,  around  $50  to  the  total  cost  of  the 
item 

• Does  this  mean  graphics  should  not  be  used? 

- No,  but  it  does  mean  that  graphics  should  only  be  used  if 
they  (a)  increase  the  clarity  of  the  item  or  (b)  are 
essential  to  the  content  of  the  item  (i.e.,  in  geometry) 

- Graphics  may  be  necessary  for  some  standards! 

• There  is  also  no  clear  research  on  the  effect  of 
adding  a graphic  to  an  item  (Kettler,  Elliott,  & 
Beddow,  2009) 


Graphics  in  Items  (cont.) 

• Graphics  can  be  in  question/stem,  and/or  in 
answer  options! 

• If  you  as  an  Item  Writer  or  Reviewer  want  to 
add  graphics,  they  have  two  options: 

1.  Describe  what  the  graphic  will  look  like  in  detail  in 
the  excel  sheet  (recommended  if  the  graphic  is 
simplistic). 

2.  Draw  the  graphic  by  hand  or  use  clipart  from  the 
web  in  the  "Graphics  Template"  provided. 
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Describe  what  the  graphic  will  look  like  in 
detail  in  the  excel  sheet  (recommended  if  the 
graphic  is  simplistic). 

tW«Ttax  >«»•••«■<  P >»«?»•«*'  *i  If**. 

4>mBE5  ftjwagpna  ‘V^inJTTr^ 

M!>  M • 

!C<  i 

»r*»  '*■'» 

*«ra  niMn  mo  » i 

iMunMHtaatnM-  r.rM  « J • rM  'iMn  ll 

otoo 

u**» 

Norbi  r<  •••*'* 

, !»■  r i»— » w »»■ 

nbM 

Protocol  for  Hand  Drawn  Graphics 


• Draw  the  graphic  by  hand  using  "Graphic  Template" 

• Matching  Item  ID  exactly! 


jgmeir^  l tyl  \y- 


J U 
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Protocol  for  Hand  Drawn  Graphics 
(as  it  is  seen  in  easyCBM) 


The  head  is  a 


A.  wangle 

B.  circle 

C.  square 


Protocol  for  Hand  Drawn  Graphics 

• Use  clipart  from  the  web  and  enter  into  "Graphics 
Template" 

http://www.fotosearch.com/ 


Note.  We  will  not  use  any  of  the  clipart  in  the  actual  items, 
but  it  is  a way  to  communicate  approximately  what  the 
graphic  should  look  like. 
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Use  Basic  Codes  in  ItemSet  Spreadsheets 

(see  ExampleSheet  K-5CCSS.docx  for  more) 

• Image:  [img]item_7NS3008.png[/img] 

• Division  symbol:  Bt4  = 3[divide]4  = 3[div]4 

• Long  division:  3[longdiv]42[/longdiv] 

• Square  roots:  V25  = [squareroot]25[/ 
squareroot] 

• Pi:  Jt  = [pi] 

• Vertically  stacked  add/sub/multiply: 

[plus]30:40:12[/plus]  30 

40 
+ 12 


Excel  Sheet  (see  Example  Problems) 
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The  Basic  Process 

Item  Writers: 

• You  will  write  and  turn  items  in  batches, 
approximately  ~20-40  items  at  a time,  and  email 
them  to  me  for  a quick  check  for  completeness 
and  quality,  with  all  250  items,  two  completed 
ItemSet  spreadsheets  due  by  Friday,  January  11th, 
2013. 

• I will  email  OKd  items  to  Item  Reviewers. 

• Item  Reviewers  will  individually  be  reviewing, 
editing  aj[  items  for  ways  to  improve  them,  and 
returning  them  to  me,  but  they  should  be  a 
strong  as  you  can  get  them  before  emailing  them 
to  me. 


The  Basic  Process  (cont.) 

Item  Reviewers: 

• After  you  have  reviewed/edited  all  items  in  an 
item  set  and  deemed  them  to  be  (a)  aligned  to 
the  standard,  (b)  mathematically  accurate,  (c) 
grade-level  appropriate,  (d)  free  of  bias,  and  (e) 
"good"  overall  items,  you  turn  in  the  ItemSet 
spreadsheet  to  me  at  BRT. 

• Email  items  back  to  me  in  batches,  a full  ItemSet 
(i.e.,  125  group  of  grade-level  items  from  a single 
Item  Writer)  at  a time  ->  you  will  turn  in  a total 
of  four  of  these  for  your  grade,  with  all  ItemSets 
due  by  Friday,  January  25th,  2013 
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Deadlines  and  Compensation 

• Compensation  will  be  released  upon  completion 
of  your  work,  pending  approval  by  BRT  and  the 
University  of  Oregon  (me) 

• $800  for  Item  Writers  completing  two  ItemSets 
of  125  items  each,  250  total  ->  January,  11th, 
2013 

• $1500  for  Item  Reviewers  for  reviewing/editing 
500  grade-level  math  items  ->  January,  25th, 
2013 


Study-related  or 
Procedural 
QUESTIONS? 
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Some  Basic  Item  Writing 
Guidelines 
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Why  multiple 

choice  items? 

“Selected-response  items  are  the  most  appropriate  item 

format  for  measuring  cognitive  achievement  or  ability, 

especially  higher  order  cognitive  achievement  or  cognitive 

abilities,  such  as  problem  solving,  synthesis,  and 

evaluation.”  (Downing,  2006,  p.  288) 

• Validity 

• Efficiency 

— Less  chance  of 

— Easy  to  administer 

construct  irrelevant 

— Easy  to  produce 

variance  in  scores 

— Easy  to  score 

— Allow  a given  skill 

objectively  (as 

to  be  assessed 

opposed  to 
constructed 

multiple  times 

response  item 

(multiple  items) 

types) 

How  do  you  write  a good  item? 

Art  or  SCIENCE?  (maybe  a little  of  both) 


Answer  Options: 

• Use  only  3 options:  1 
correct  response  and  2 
distracters 

• Choose  logical  distracters 

• Avoid  excess  text  or 
irrelevant  features 


Assess  Only  Target  Knowledge: 

• Targeting  Math 

• Reduce  language  as  much  as 
possible 

• If  the  item  is  supposed  to 
assess  fractions,  make  sure  it 
doesn't  assess  other  factors, 
such  as  conversions  or 
estimations. 

Be  Sensitive  of  Bias  Issues: 

• Keep  in  mind  the  population  of 
students  who  will  be  taking  the 
items 

• Consider  ELL,  SWD,  diverse 
cultures,  etc. 
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Universal  Design 

How  should  we  design  a building  so  the  widest  range 
of  populations  possible  can  access  it? 


Universal  Design  for  Assessment 


• Considers  all  characteristics  of  test-takers. 

• Precisely  defined  constructs. 

• Accessible,  non-biased  items. 

•"  Items  amendable  foaccommodanonsl  j 

• Simple,  clear,  and  intuitive  instructions  and  j 

procedures.  I 


Maximum  readability  and  comprehensibility. 

Maximum  legibility  of  text,  tables,  figures,  and 
illustrations 


Thompson,  Johnstone,  and  Thurlow  (2002) 
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TABLE  1 

A Revised  Taxonomy  of  Multiple-Choice  (MC)  hem- Writing  Guidelines 


Content  concerns 

1.  Every  item  should  reflect  specific  content  and  a single  specific  menial  behavior,  as  called  for  in 
test  specifications  (two-way  grid,  test  blueprint). 

2.  Base  each  item  on  important  content  to  learn:  avoid  trivial  conlenL 

3.  Use  novel  material  to  test  higher  level  learning.  Paraphrase  textbook  language  or  language  used 
during  instruction  when  used  in  a test  item  to  avoid  testing  for  simply  recall. 

4.  Keep  the  content  of  each  item  independent  from  content  of  other  items  on  the  tesL 

5.  Avoid  over  specific  and  over  general  content  when  writing  MC  items. 

6.  Avoid  opinion-based  items. 

7.  Avoid  trick  items. 

8.  Keep  vocabulary  simple  for  the  group  of  students  being  tested. 

Formatting  concerns 

9.  Use  the  question,  completion,  and  best  answer  versions  of  the  conventional  MC,  the  alternate 
choice,  true-false  (TF).  multiple  true-false  (MTF).  matching,  and  the  context-dependent  item 
and  item  set  formats,  but  AVOID  the  complex  MC  (Type  K)  format. 

10.  Format  the  item  vertically  instead  of  horizontally. 

Style  concerns 

1 1.  Edit  and  proof  items. 

12.  Use  correct  grammar,  punctuation,  capitalization,  and  spelling. 

13.  Minimize  the  amount  of  reading  in  each  item. 

Writing  the  stem 

14.  Ensure  that  the  directions  in  the  stem  are  very  clear. 

15.  Include  the  central  idea  in  the  stem  instead  of  the  choices. 

16.  Avoid  window  dressing  (excessive  verbiage). 

17.  Word  the  stem  positively,  avoid  negatives  such  as  NOT  or  EXCEPT.  If  negative  words  are  used, 
use  the  word  cautiously  and  always  ensure  that  the  word  appears  capitalized  and  boldface. 


TABLE  1 

A Revised  Taxonomy  of  Multiple-Choice  (MC)  Hem-Writing  Guidelines 


Writing  the  choices 

18.  Develop  as  many  effective  choices  as  you  can.  but  research  suggests  three  is  adequate. 

19.  Make  sure  that  only  one  of  these  choices  is  the  right  answer. 

20.  Vary  the  location  of  the  right  answer  according  to  the  number  of  choices. 

21 . Place  choices  in  logical  or  numerical  order. 

22.  Keep  choices  independent:  choices  should  not  be  overlapping. 

23.  Keep  choices  homogeneous  in  content  and  grammatical  structure. 

24.  Keep  the  length  of  choices  about  equal. 

25.  None-of-lhe-uboxe  should  be  used  carefully. 

26.  Avoid  All-of-the -above. 

27.  Phrase  choices  positively:  avoid  negatives  such  as  NOT. 

28.  Avoid  giving  clues  to  the  right  answer,  such  as 

a.  Specific  determiners  including  always,  never,  completely,  and  absolutely. 

b.  Clang  associations,  choices  identical  to  or  resembling  words  in  the  stem. 

c.  Grammatical  inconsistencies  that  cue  the  test-taker  to  the  correct  choice. 

d.  Conspicuous  correct  choice. 

e.  Pairs  or  triplets  of  options  that  clue  the  test-taker  to  the  correct  choice. 

f.  Blatantly  absurd,  ridiculous  options. 

29.  Make  all  distractors  plausible. 

30.  Use  typical  errors  of  students  to  write  your  distractors. 

31.  Use  humor  if  it  is  compatible  with  the  teacher  and  the  learning  environment. 


Haladyna,  2002,  p.  312 
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Content  Concerns 

“Every  item  should  reflect  specific  content  and  a single 
specific  cognitive  process”  (Haladyna,  2004,  p.  98). 

Guidelines 

• Write/review  items  that  align  with  only  one  standard 
(or  one  part  of  one  standard),  and  that  the  item 
targets  that  standard  clearly  and  directly. 

— Target  only  one  skill  in  each  item.  If  standard  asks  for 
multiple  skills,  use  multiple  items. 

• Try  not  to  be  over-specific  or  over-general. 

• Try  not  to  "trick  the  students" 

• Each  item  should  be  independent  of  all  others. 

• Avoid  focusing  items  on  trivial  parts  of  standards. 

• Present  items  in  novel  formats 

Note.  The  following  slides  are  largely  based  on  Haladyna,  2004. 


Targeting  Only  One  Skill 

Standard  6.SP:  Recognize  that  a measure  of  center  for  a numerical  data  set  summarizes  all  of 
its  values  with  a single  number,  while  a measure  of  variation  describes  how  its  values  vary  with 

a single  number. 

Example  item  1 

Example  item  2 

Which  number 

Which  number 

describes  the  center  of 

describes  the  center  of 

the  dataset? 

the  dataset? 

Dataset:  5,  7,  3,  3 

Dataset:  5,  7,  3,  3 

A)  Average  -4.50 

A)  4.50 

B)  Standard  deviation  - 1.91 

B)  1.91 

C)  Range -4.00 

C)  4.00 
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Targeting  Only  One  Skill 

Example  item  1 

Example  item  2 

• The  first  item  provides  the 

• Second  item  requires 

student  with  the  name  of 

student  to  both  know  the 

the  statistic  AND  the 

best  statistic  (average)  AND 

number. 

to  recognize  which  number 

• The  target  skill  of  the  item 
(measure  of  central 

represents  that  statistic. 

tendency)  is  not  confused 

• Item  has  less  text,  but  in 

with  other  math  skills. 

this  case,  the  text  may  help 

HOWEVER - 
• Item  still  requires 

vocabulary  and  additional 
reading  skills  over  a simpler 
version 

target  the  skill  of  interest. 

Targeting  Only  One  Skill 

• Both  items  target  only  one  part  of  the 
standard  (central  tendency),  yet  item  2 still 
targets  multiple  math  skills. 

— Note:  if  we  were  interested  in  knowing  students' 
skills  with  calculating  the  average,  we  could  easily 
address  it  with  a different  item. 

Example 

The  average  of:  4,  3,  9,  4 = ? 

- A)  5 

- B)  20 
-C)4 
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Over-specific/Over-general 

Over-specific  item 

Over-general  item 

Who  wrote  the  Icon  of  Seville? 

Which  is  the  most  serious 

A)  Lorca 

problem  in  the  world? 

B)  Ibanez 

A)  hunger 

C)  Rodriguez 

B)  lack  of  education 

C)  disease 

Over-specific  items  often  assess 

Over-general  items  are  often 

trivial  content. 

opinion-based. 

Balancing  the  generality  of  an  item  is 

part  of  the  "art"  of  writing  good  items. 

Note.  Examples  from  Haladyna,  2004,  p.  102. 

Trick  Questions 

• Is  there  a fourth  of  July  in  England? 

Yes,  there  is  a fourth  of  July  everywhere. 

• Some  months  have  31  days.  How  many  have 
28? 

All  of  them 

• How  many  animals  of  each  gender  did  Moses 
bring  on  his  ship? 

None.  Moses  didn't  have  a ship,  Noah  did. 

• A butcher  in  the  meat  market  is  six  feet  tall. 
What  does  he  weigh? 

Meat 

Note.  Examples  from  Haladyna,  2004,  p.  104. 
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Trick  Questions 

“There  are  enough  problems  in  testing 
without  contributing  more  by  using  trick 
items.”  (Haladyna,  2004,  p.  104) 


Formatting  Concerns 

• Make  sure  stem  is  a complete  sentence/ 
directive. 

• Make  sure  item  is  multiple  choice,  and 
contains  three  options  (correct  response  and 
two  plausible  distracters). 

• Correct  response  is  always  answer  Option  A 

— Because  items  will  be  computer-administered,  we 
will  randomly  rotate  all  options.  For  development 
purposes,  it's  easiest  to  always  keep  the  correct 
response  in  a consistent  location. 

All  other  formatting  concerns  are  BRT  responsibility 
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Style  Concerns 

• Please  proof  read  all  items  you  wrote  before  you 
turn  them  over  to  me  (both  Writers  and 
Reviewers) 

• Primary  things  to  look  for: 

— Grammar 

- Can  the  reading  load  be  reduced  without  losing 
clarity? 

— Is  there  more  than  one  construct/skill? 

— Bias  and  sensitivity  (i.e.,  variety  of  diverse  names  - 
Google  them!) 


Stem  Construction 

• Try  to  be  as  clear  and  concise  as  possible 

• Make  sure  the  stem  is  complete  and  contains 
all  the  information  needed  to  solve  the 
problem. 
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Developing  Options  (correct  option 
and  two  plausible  distractors) 

• Probably  the  most  difficult  part  of  an  item  to 
develop. 

• Answer  options  must  be  reasonable  and  have 
only  one  justifiably  correct  answer  (e.g.,  if  you 
can  make  a reasonable  argument  that  one  of 
the  distracters  is  also  correct,  it  is  not  a good 
distracter). 

• You're  an  expert!!!  Think  about  the  common 
math  mistakes  your  students  make! 


Developing  Options  (cont.) 

In  a perfectly  functioning  item... 

• Stem  contains  all  the  information  needed  to 
solve  the  question 

— Answer  option  A is  the  correct  response,  and  will  be 
chosen  by  students  who  understand  the  content 
targeted  by  the  item. 

— Answer  option  B is  a close  distracter,  and  will  be 
chosen  by  students  who  have  partial,  but  incomplete 
knowledge  of  the  content  targeted  by  the  item. 

— Answer  option  C is  a far  distracter  (but  not  TOO  far), 
and  will  be  chosen  by  students  who  have  little  to  no 
knowledge  of  the  content  targeted  by  the  item. 
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Developing  Options  (cont.) 

• Keep  format  of  each  option  the  same  (length, 
grammar,  etc.) 

• Do  not  use  "all  of  the  above"  or  "none  of  the 
above" 

• Keep  distracters  plausible,  but  avoid  hinting  at 
the  correct  response. 

• Try  to  use  distracters  that  represent  typical 
student  errors 


Developing  Options  (cont.) 

• Although  guidelines  can  help,  coming  up  with 
reasonable  options  is  difficult.  Getting  the 
options  to  all  function  the  way  they  are 
intended  to  is  even  more  difficult. 

— Why  some  refer  to  item  writing  as  an  art  (as 
opposed  to  a science)  it's  a little  of  both 
though! 
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Hypothetical  Example 

• Imagine  a kindergarten  or  first  grade  standard 
that  requires  students  have  knowledge  of 
basic  geometric  shapes  - faces,  sides,  angles, 
etc. 

— i.e.,  squares,  circles,  triangles,  rectangles,  etc. 


Item  Non-Example 

Greg  and  Sally  were  both  in  the  first  grade.  Greg 
liked  the  color  blue  and  always  wore  a blue  shirt. 
Sally  liked  the  color  green  and  always  wore  a 
green  shirt.  Which  shirt  has  more  triangles  on 
it? 


a)  blue  c)  Sally  e)  triangles 

b)  green  d)  Greg 
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Why  this  is  a poor  item 

• Way  too  much  text 

• Lots  of  irrelevant  information 

• Low-cognitive-level  question  (basically  counting  - 
though  some  standards  this  skill  is  targeted) 

• What  if  the  student  is  color  blind? 

• Too  many  options 

- Not  logical  distracters 

— There  is  arguably  more  than  one  correct  response 
option  (either  blue  or  Greg) 

• Doesn't  really  address  the  standard 


Item  non-example  2 

Triangles: 

a)  have  three  sides 

b)  have  two  long  sides  and  two  short  sides 

c)  have  rounded  edges 

d)  all  of  the  above 

e)  none  of  the  above 
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Why  this  is  a poor  item 

• Stem  does  not  present  the  information 
needed  solve  the  problem. 

• Uses  the  "all  of  the  above"  and  "none  of  the 
above"  options 

— Although  there  is  some  empirical  evidence 
supporting  that  the  "all  of  the  above"  option 
increases  the  difficulty  (Huang,  Trevisan,  & 
Storfer,  2007),  the  general  consensus  is  that  it 
creates  a "cueing"  effect  for  students.  Also, 
students  may  choose  these  options  with  mis-  or 
partial  knowledge. 
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Why  is  this  a better  item? 

• Clearly  addresses  the  standard 

• Low  level  of  text 

• No  irrelevant  information 


Language  Issues 


For  math  items,  excess  text  threatens  validity 

- Particularly  worrisome  for  English  language 
learners  (ELL) 


What  to  do? 


— Use  familiar,  grade- 
level  appropriate 
words 

— Omit  all  unnecessary 
words 

— Use  no  text  if  possible, 
or  keep  sentences  as 
brief  as  possible 


— Avoid  conditional 
and  relative  clauses 

— Avoid  negation 

— Use  concrete 
versus  abstract 
representation 
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Now....  Time  to  look  at  some  real  items! 

Existing  easyCBM  items 


Existing  easyCBM  items 

• Note.  There's  only  a limited  amount  we  can 
learn  from  these  items 

— Aligned  to  different  standards 
— Developed  for  a different  population 

However 

• Formatting  will  be  similar 

• Universal  design  features  evident 

• Good  item  writing  principles  applied 

• Perhaps  most  important  - We  know  they  work! 
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Existing  easyCBM  item 

Standard:  Solve  problems  about  similar  objects  (including  figures)  by  using  scale 
factors  that  relate  corresponding  lengths  of  the  objects  or  by  using  the  fact  that 
relationships  of  lengths  within  an  object  are  preserved  in  similar  objects. 

• Universal  Design  features? 

• Targets  a single  skill? 

• Over-specific/over-general? 

• Clear  and  concise? 

• Alignment? 

• Other  concerns? 

a.  \ in.  Remember:  These  items  were  designed  for  very  low 

b.  4 in.  performing  students.  The  new  items  should  target 

c.  5 in.  students  at  or  slightly  below  grade-level  expectations. 


Existing  easyCBM  item 

Standard:  Use  descriptive  statistics,  including  mean,  median,  and  range,  to  summarize 
and  compare  data  sets. 


B.  $9 

C.  $12 


• Universal  Design  features? 

• Targets  a single  skill? 

• Over-specific/over-general? 

• Clear  and  concise? 

• Alignment? 

• Other  concerns? 
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One  more... 

Standard:  Explain  why  the  sum  of  the  measures  of  the  angles  in  a triangle  is  180 
degrees,  and  they  apply  this  fact  about  triangles  to  find  unknown  measures  of  angles. 

• Universal  Design  features? 

• Targets  a single  skill? 

• Over-specific/over-general? 

• Clear  and  concise? 

• Alignment? 

• Other  concerns? 

A.  38° 

B.  71° 

C.  16° 


How  do  you  become  a good  item  writer? 

“Effective  item  writers  are  trained,  not 
born...  Although  item  writers  must  be 
expert  in  their  own  disciplines,  there  is  no 
reason  to  believe  that  their  subject  matter 
expertise  generalizes  to  effective  item 
writing  expertise.” 

(Downing,  2006,  p.  11) 
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Bottom  line 

“Practice  does  not  make  perfect.  Only 
perfect  practice  makes  perfect.” 
-Vince  Lombardi 

• Practice,  practice,  practice. 

- Practice  writing  different  types  of  items 

• Geometry,  number  & operation,  etc. 

- Look  back  at  other  test  items 

• Find  examples  of  good  and  bad  items 


Resources 

• Multiple  choice  item  writing  Do's  and  Don'ts 

— http://www.eric.ed.gov/PDFS/ED398238.pdf 

• Recommendations  portion  of  the  following 
IDEA  paper 

- http://www.theideacenter.org/IDEAPaperl6 

Plenty  more  resources  online  can  be  found  with 
a quick  Google  search. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

1 

1 

2G13 

-1.65 

69 

65 

0.54 

1.03 

0.20 

0.80 

0.06 

0.23 

0.99 

1 

2 

2G331 

-1.12 

83 

75 

0.39 

1.02 

0.17 

0.89 

-0.03 

0.24 

0.99 

1 

3 

2G115 

0.54 

68 

53 

0.33 

1.02 

0.18 

0.88 

-0.29 

0.43 

1.01 

1 

4 

23123 

-0.96 

46 

40 

0.47 

1.03 

0.19 

0.94 

0.14 

0.30 

0.98 

1 

5 

23374 

-0.54 

44 

34 

0.43 

0.97 

-0.07 

0.78 

-0.35 

0.51 

1.08 

1 

6 

23112 

-0.47 

45 

36 

0.42 

0.92 

-0.26 

0.80 

-0.16 

0.47 

1.10 

1 

7 

23357 

-0.21 

46 

33 

0.41 

0.95 

-0.17 

0.81 

-0.30 

0.58 

1.09 

1 

8 

23338 

0.15 

45 

30 

0.37 

1.11 

0.64 

1.06 

0.29 

0.46 

0.83 

1 

9 

2MD104 

0.91 

68 

47 

0.31 

0.80 

-1.38 

0.78 

-0.67 

0.61 

1.29 

1 

10 

23294 

1.46 

45 

24 

0.36 

0.69 

-2.11 

0.57 

-1.71 

0.71 

1.63 

1 

11 

21568 

-1.31 

44 

39 

0.51 

0.87 

-0.30 

0.59 

-0.26 

0.39 

1.14 

1 

12 

21521 

-1.00 

46 

39 

0.47 

0.81 

-0.64 

1.08 

0.33 

0.49 

1.11 

1 

13 

2NBT918 

-0.76 

70 

60 

0.37 

1.01 

0.12 

1.08 

0.31 

0.30 

0.97 

1 

14 

2NBT63 

-0.61 

84 

72 

0.33 

1.04 

0.25 

0.86 

-0.17 

0.29 

0.98 

1 

15 

2NBT38 

0.04 

76 

57 

0.29 

0.88 

-0.84 

0.73 

-1.02 

0.47 

1.22 

1 

16 

2NBT610 

0.61 

153 

104 

0.19 

0.83 

-2.16 

0.73 

-1.82 

0.54 

1.37 

1 

17 

21893 

1.81 

55 

24 

0.32 

1.05 

0.41 

0.94 

-0.19 

0.50 

0.95 

1 

18 

20A236 

-0.64 

69 

62 

0.42 

0.97 

0.01 

1.22 

0.55 

0.29 

1.00 

1 

19 

2OA340 

-0.38 

97 

84 

0.32 

0.96 

-0.15 

1.29 

0.80 

0.36 

1.01 

1 

20 

22108 

-0.11 

45 

34 

0.40 

0.90 

-0.52 

0.85 

-0.17 

0.52 

1.15 

1 

21 

22052 

0.02 

44 

33 

0.40 

0.77 

-1.18 

0.52 

-1.10 

0.61 

1.37 

1 

22 

20A318 

0.17 

89 

70 

0.28 

1.00 

0.05 

0.86 

-0.42 

0.38 

1.03 

1 

23 

22396 

0.31 

44 

32 

0.39 

1.09 

0.51 

1.00 

0.10 

0.44 

0.90 

1 

24 

20A34 

0.65 

153 

103 

0.19 

0.99 

-0.13 

0.98 

-0.09 

0.42 

1.04 

1 

25 

22323 

1.57 

45 

24 

0.36 

1.02 

0.21 

0.99 

0.07 

0.52 

0.96 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

2 

1 

2G142 

-1.63 

72 

69 

0.61 

0.99 

0.16 

0.46 

-0.44 

0.26 

1.05 

2 

2 

2G313 

-1.13 

67 

61 

0.46 

0.98 

0.03 

0.64 

-0.30 

0.34 

1.05 

2 

3 

2G39 

0.29 

78 

55 

0.27 

0.99 

-0.08 

1.00 

0.05 

0.40 

1.01 

2 

4 

23361 

-0.91 

44 

38 

0.48 

0.83 

-0.54 

0.58 

-0.47 

0.43 

1.19 

2 

5 

23063 

-0.56 

45 

35 

0.42 

0.98 

-0.01 

0.80 

-0.30 

0.50 

1.05 

2 

6 

23347 

-0.47 

45 

38 

0.45 

1.17 

0.67 

1.06 

0.28 

0.26 

0.87 

2 

7 

23058 

-0.19 

44 

32 

0.41 

1.07 

0.41 

1.20 

0.61 

0.48 

0.88 

2 

8 

2MD84 

0.13 

85 

65 

0.28 

0.85 

-1.07 

0.69 

-1.28 

0.50 

1.25 

2 

9 

23077 

0.90 

42 

26 

0.37 

1.23 

1.45 

1.49 

1.51 

0.36 

0.39 

2 

10 

2MD54 

1.45 

71 

33 

0.28 

0.72 

-2.53 

0.65 

-2.33 

0.67 

1.62 

2 

11 

2NBT319 

-1.31 

69 

65 

0.53 

0.99 

0.11 

0.85 

0.09 

0.23 

1.01 

2 

12 

2NBT815 

-1.00 

97 

89 

0.39 

0.92 

-0.19 

0.83 

-0.12 

0.35 

1.05 

2 

13 

21628 

-0.75 

44 

38 

0.48 

0.88 

-0.30 

0.61 

-0.50 

0.45 

1.13 

2 

14 

21588 

-0.65 

44 

37 

0.46 

0.91 

-0.29 

0.64 

-0.44 

0.45 

1.14 

2 

15 

2NBT52 

0.04 

84 

65 

0.28 

0.89 

-0.73 

0.75 

-0.78 

0.46 

1.18 

2 

16 

21873 

0.64 

45 

26 

0.36 

0.89 

-0.67 

0.72 

-0.94 

0.60 

1.27 

2 

17 

21817 

1.78 

45 

16 

0.37 

0.93 

-0.34 

0.83 

-0.38 

0.55 

1.14 

2 

18 

20A332 

-0.63 

70 

59 

0.35 

0.78 

-1.09 

0.52 

-1.25 

0.53 

1.25 

2 

19 

22158 

-0.38 

45 

36 

0.43 

0.93 

-0.24 

0.64 

-0.40 

0.50 

1.14 

2 

20 

20A222 

-0.12 

66 

57 

0.39 

1.18 

0.78 

1.33 

0.77 

0.23 

0.80 

2 

21 

20A323 

0.02 

69 

50 

0.30 

1.00 

0.05 

1.06 

0.31 

0.40 

0.96 

2 

22 

22284 

0.17 

45 

32 

0.36 

0.97 

-0.13 

0.86 

-0.46 

0.43 

1.09 

2 

23 

22186 

0.29 

45 

33 

0.41 

1.06 

0.33 

0.93 

-0.03 

0.54 

0.96 

2 

24 

22310 

0.61 

45 

28 

0.35 

0.97 

-0.18 

0.93 

-0.19 

0.46 

1.08 

2 

25 

22357 

1.52 

45 

19 

0.35 

0.78 

-1.61 

0.65 

-1.45 

0.64 

1.54 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

3 

1 

2G131 

-1.63 

174 

164 

0.34 

1.10 

0.46 

1.29 

0.70 

0.10 

0.92 

3 

2 

2G323 

-1.16 

98 

91 

0.41 

1.03 

0.20 

1.17 

0.47 

0.25 

0.98 

3 

3 

2G319 

0.58 

78 

51 

0.26 

1.00 

0.02 

0.93 

-0.33 

0.43 

1.03 

3 

4 

23197 

-0.90 

45 

39 

0.50 

1.57 

1.60 

1.45 

0.85 

0.13 

0.58 

3 

5 

23224 

-0.56 

45 

37 

0.43 

1.05 

0.29 

0.80 

-0.26 

0.41 

0.99 

3 

6 

2MD61 

-0.47 

69 

61 

0.40 

0.89 

-0.33 

1.30 

0.68 

0.33 

1.02 

3 

7 

23370 

-0.20 

44 

31 

0.39 

1.01 

0.10 

0.82 

-0.30 

0.51 

1.03 

3 

8 

23352 

0.15 

45 

30 

0.35 

0.98 

-0.08 

0.83 

-0.50 

0.47 

1.10 

3 

9 

2MD810 

0.93 

80 

59 

0.29 

0.93 

-0.45 

0.99 

0.07 

0.49 

1.11 

3 

10 

2MD315 

1.47 

80 

52 

0.27 

1.08 

0.68 

1.15 

0.77 

0.42 

0.83 

3 

11 

2NBT914 

-1.31 

69 

65 

0.53 

1.10 

0.37 

0.94 

0.20 

0.16 

0.94 

3 

12 

2NBT314 

-0.98 

84 

75 

0.37 

0.83 

-0.60 

0.53 

-0.86 

0.42 

1.15 

3 

13 

21573 

-0.75 

46 

39 

0.45 

0.97 

-0.01 

0.83 

-0.14 

0.37 

1.04 

3 

14 

21671 

-0.60 

45 

37 

0.43 

0.76 

-0.95 

0.50 

-1.14 

0.56 

1.29 

3 

15 

2NBT310 

0.04 

76 

57 

0.29 

0.99 

-0.04 

0.85 

-0.48 

0.39 

1.05 

3 

16 

2NBT220 

0.63 

85 

58 

0.26 

0.97 

-0.22 

0.97 

-0.12 

0.42 

1.05 

3 

17 

21862 

1.77 

50 

21 

0.34 

0.98 

-0.07 

0.97 

-0.04 

0.52 

1.03 

3 

18 

20A212 

-0.62 

76 

64 

0.33 

0.88 

-0.55 

0.83 

-0.32 

0.39 

1.12 

3 

19 

22081 

-0.39 

45 

35 

0.40 

1.06 

0.33 

1.02 

0.18 

0.36 

0.94 

3 

20 

22147 

-0.12 

44 

33 

0.39 

0.84 

-0.83 

0.89 

-0.18 

0.48 

1.20 

3 

21 

22279 

0.02 

45 

33 

0.38 

0.98 

-0.05 

0.85 

-0.33 

0.46 

1.06 

3 

22 

22293 

0.22 

44 

28 

0.39 

0.73 

-1.47 

0.55 

-1.44 

0.71 

1.42 

3 

23 

22096 

0.35 

46 

34 

0.38 

0.90 

-0.51 

0.74 

-0.58 

0.51 

1.19 

3 

24 

20A21 

0.61 

70 

46 

0.28 

0.88 

-0.97 

0.76 

-1.19 

0.54 

1.28 

3 

25 

22354 

1.46 

45 

22 

0.37 

0.80 

-1.21 

0.66 

-1.35 

0.68 

1.39 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

4 

1 

2G342 

-1.54 

67 

64 

0.61 

0.93 

0.02 

0.35 

-0.54 

0.32 

1.09 

4 

2 

2G132 

-1.16 

74 

66 

0.39 

1.04 

0.23 

0.87 

-0.07 

0.27 

0.98 

4 

3 

2G214 

0.28 

69 

51 

0.30 

1.11 

0.83 

1.24 

0.94 

0.26 

0.78 

4 

4 

23190 

-0.90 

45 

38 

0.46 

1.04 

0.23 

1.46 

0.80 

0.32 

0.87 

4 

5 

23290 

-0.57 

45 

36 

0.45 

0.90 

-0.29 

0.70 

-0.44 

0.56 

1.13 

4 

6 

23348 

-0.45 

45 

36 

0.43 

0.93 

-0.25 

0.60 

-0.55 

0.52 

1.15 

4 

7 

23353 

-0.18 

46 

34 

0.40 

0.86 

-0.65 

1.03 

0.24 

0.52 

1.13 

4 

8 

23387 

0.12 

45 

32 

0.39 

1.11 

0.57 

1.19 

0.64 

0.45 

0.84 

4 

9 

2MD49 

0.95 

69 

48 

0.29 

0.65 

-2.96 

0.51 

-2.39 

0.70 

1.65 

4 

10 

2MD1012 

1.43 

69 

36 

0.27 

0.74 

-2.61 

0.68 

-2.53 

0.67 

1.71 

4 

11 

21507 

-1.31 

44 

39 

0.52 

1.04 

0.22 

0.95 

0.24 

0.32 

0.96 

4 

12 

21674 

-0.98 

47 

42 

0.51 

1.12 

0.45 

0.70 

-0.22 

0.31 

0.98 

4 

13 

2NBT916 

-0.75 

67 

59 

0.41 

0.89 

-0.36 

0.94 

0.11 

0.39 

1.07 

4 

14 

21502 

-0.65 

45 

37 

0.45 

0.62 

-1.60 

0.51 

-1.08 

0.61 

1.38 

4 

15 

21587 

0.04 

44 

30 

0.38 

0.99 

0.01 

0.87 

-0.22 

0.50 

1.04 

4 

16 

2NBT911 

0.66 

97 

71 

0.26 

1.11 

0.86 

1.20 

0.93 

0.34 

0.82 

4 

17 

21825 

1.75 

44 

16 

0.36 

1.00 

0.02 

0.98 

-0.01 

0.47 

1.02 

4 

18 

22345 

-0.60 

45 

36 

0.42 

0.90 

-0.38 

0.75 

-0.40 

0.50 

1.13 

4 

19 

22291 

-0.43 

44 

35 

0.43 

0.94 

-0.18 

0.77 

-0.33 

0.48 

1.10 

4 

20 

22280 

-0.13 

202 

154 

0.18 

1.00 

-0.02 

1.01 

0.13 

0.38 

0.99 

4 

21 

22385 

0.02 

45 

30 

0.37 

1.02 

0.17 

0.84 

-0.44 

0.49 

1.04 

4 

22 

22249 

0.19 

45 

31 

0.36 

0.83 

-1.02 

0.77 

-0.87 

0.53 

1.33 

4 

23 

22194 

0.29 

44 

31 

0.39 

1.20 

1.04 

1.17 

0.57 

0.41 

0.72 

4 

24 

22349 

0.61 

45 

32 

0.37 

0.84 

-0.89 

0.72 

-0.91 

0.55 

1.29 

4 

25 

20A15 

1.44 

66 

43 

0.30 

1.04 

0.32 

1.06 

0.35 

0.45 

0.91 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

5 

1 

2G120 

-1.47 

167 

157 

0.34 

1.04 

0.24 

1.20 

0.54 

0.18 

0.96 

5 

2 

2G336 

-1.18 

69 

63 

0.44 

0.89 

-0.25 

0.49 

-0.85 

0.37 

1.12 

5 

3 

2G121 

0.74 

74 

44 

0.28 

1.04 

0.42 

0.98 

-0.07 

0.47 

0.93 

5 

4 

23255 

-1.03 

44 

37 

0.45 

0.80 

-0.74 

0.58 

-0.56 

0.50 

1.22 

5 

5 

2MD64 

-0.59 

153 

131 

0.24 

1.12 

0.83 

1.17 

0.62 

0.19 

0.86 

5 

6 

23282 

-0.44 

44 

34 

0.42 

0.75 

-1.08 

0.59 

-0.92 

0.61 

1.30 

5 

7 

2MD211 

-0.20 

167 

139 

0.22 

1.04 

0.36 

1.02 

0.16 

0.32 

0.95 

5 

8 

23339 

0.15 

45 

31 

0.37 

0.86 

-0.84 

0.68 

-0.92 

0.54 

1.32 

5 

9 

2MD72 

0.95 

85 

53 

0.25 

1.16 

1.53 

1.26 

1.61 

0.28 

0.57 

5 

10 

23301 

1.47 

45 

29 

0.36 

1.10 

0.68 

1.30 

1.07 

0.41 

0.71 

5 

11 

21696 

-1.31 

46 

40 

0.48 

1.23 

0.83 

1.45 

0.76 

0.22 

0.78 

5 

12 

21710 

-0.97 

45 

38 

0.45 

0.96 

-0.07 

0.58 

-0.48 

0.42 

1.12 

5 

13 

2NBT99 

-0.77 

74 

64 

0.36 

1.03 

0.19 

1.14 

0.50 

0.21 

0.96 

5 

14 

21627 

-0.60 

54 

45 

0.42 

0.81 

-0.75 

0.53 

-0.82 

0.56 

1.22 

5 

15 

21571 

0.04 

44 

32 

0.40 

0.96 

-0.15 

0.90 

-0.03 

0.52 

1.05 

5 

16 

21517 

0.72 

45 

27 

0.35 

1.05 

0.39 

1.08 

0.39 

0.45 

0.88 

5 

17 

21872 

1.74 

45 

18 

0.37 

0.70 

-1.98 

0.56 

-1.01 

0.68 

1.58 

5 

18 

22251 

-0.59 

45 

36 

0.42 

0.89 

-0.40 

0.63 

-0.54 

0.50 

1.17 

5 

19 

20A429 

-0.39 

80 

66 

0.31 

0.91 

-0.42 

0.69 

-0.86 

0.41 

1.14 

5 

20 

22071 

-0.13 

46 

33 

0.37 

0.96 

-0.21 

0.85 

-0.45 

0.46 

1.11 

5 

21 

22179 

0.05 

45 

35 

0.41 

0.81 

-0.85 

0.75 

-0.44 

0.52 

1.22 

5 

22 

20A216 

0.19 

69 

52 

0.30 

0.98 

-0.07 

0.91 

-0.25 

0.38 

1.04 

5 

23 

22054 

0.33 

46 

31 

0.37 

0.92 

-0.36 

0.81 

-0.55 

0.56 

1.15 

5 

24 

22104 

0.62 

45 

29 

0.36 

1.09 

0.64 

1.09 

0.36 

0.41 

0.79 

5 

25 

22313 

1.44 

44 

17 

0.35 

0.78 

-1.50 

0.68 

-1.41 

0.64 

1.47 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

6 

1 

2G312 

-1.51 

68 

64 

0.55 

0.72 

-0.61 

0.26 

-0.82 

0.44 

1.19 

6 

2 

2G239 

-1.18 

135 

125 

0.35 

0.85 

-0.55 

0.39 

-1.26 

0.40 

1.14 

6 

3 

2G137 

0.58 

74 

46 

0.28 

1.17 

1.39 

1.31 

1.47 

0.38 

0.60 

6 

4 

23007 

-1.01 

44 

38 

0.48 

0.88 

-0.29 

0.59 

-0.56 

0.45 

1.13 

6 

5 

23173 

-0.58 

45 

35 

0.41 

1.17 

0.80 

1.17 

0.49 

0.35 

0.79 

6 

6 

2MD99 

-0.44 

67 

57 

0.38 

0.82 

-0.82 

0.60 

-0.70 

0.49 

1.19 

6 

7 

23109 

-0.18 

45 

34 

0.41 

1.33 

1.47 

1.12 

0.40 

0.35 

0.66 

6 

8 

2MD812 

0.12 

84 

64 

0.28 

1.10 

0.74 

0.96 

-0.04 

0.32 

0.89 

6 

9 

23102 

0.96 

46 

28 

0.36 

1.14 

0.86 

1.13 

0.55 

0.45 

0.74 

6 

10 

2MD87 

1.40 

161 

81 

0.18 

0.98 

-0.37 

1.01 

0.13 

0.44 

1.05 

6 

11 

21679 

-1.33 

45 

40 

0.52 

1.07 

0.32 

1.05 

0.36 

0.31 

0.90 

6 

12 

21522 

-0.97 

180 

163 

0.28 

0.97 

-0.13 

0.96 

0.05 

0.34 

1.03 

6 

13 

21707 

-0.77 

45 

38 

0.45 

0.80 

-0.67 

0.74 

-0.36 

0.49 

1.17 

6 

14 

21776 

-0.65 

46 

38 

0.43 

0.74 

-1.11 

0.50 

-0.70 

0.53 

1.32 

6 

15 

2NBT920 

0.04 

76 

57 

0.29 

0.85 

-1.05 

1.13 

0.54 

0.44 

1.17 

6 

16 

2NBT620 

0.70 

69 

42 

0.28 

0.98 

-0.16 

1.06 

0.37 

0.47 

1.02 

6 

17 

21871 

1.73 

44 

19 

0.37 

1.23 

1.36 

1.50 

1.65 

0.43 

0.42 

6 

18 

20A326 

-0.60 

97 

86 

0.34 

0.89 

-0.43 

0.85 

-0.19 

0.42 

1.09 

6 

19 

22010 

-0.42 

45 

36 

0.43 

1.17 

0.78 

1.25 

0.64 

0.36 

0.80 

6 

20 

20A29 

-0.13 

84 

67 

0.29 

1.03 

0.26 

0.93 

-0.10 

0.34 

0.97 

6 

21 

22142 

0.04 

44 

32 

0.42 

1.07 

0.40 

1.30 

0.74 

0.52 

0.87 

6 

22 

22154 

0.19 

46 

33 

0.39 

0.95 

-0.23 

1.05 

0.27 

0.53 

1.05 

6 

23 

22383 

0.30 

45 

32 

0.37 

0.84 

-0.88 

0.67 

-1.03 

0.57 

1.30 

6 

24 

22192 

0.64 

45 

28 

0.36 

1.07 

0.49 

1.41 

1.47 

0.43 

0.74 

6 

25 

22247 

1.41 

45 

26 

0.35 

1.02 

0.19 

1.18 

0.88 

0.47 

0.90 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

7 

1 

2G220 

-1.51 

68 

64 

0.55 

0.76 

-0.49 

0.30 

-0.72 

0.42 

1.17 

7 

2 

2G240 

-1.22 

78 

70 

0.39 

1.09 

0.41 

1.41 

0.85 

0.16 

0.88 

7 

3 

2G333 

0.67 

80 

62 

0.30 

1.15 

0.96 

1.19 

0.67 

0.33 

0.80 

7 

4 

23040 

-1.01 

45 

40 

0.53 

1.15 

0.53 

1.29 

0.59 

0.28 

0.87 

7 

5 

2MD312 

-0.53 

91 

79 

0.33 

0.96 

-0.13 

0.96 

0.04 

0.33 

1.02 

7 

6 

23258 

-0.44 

46 

38 

0.43 

1.00 

0.07 

0.96 

0.10 

0.38 

1.01 

7 

7 

23383 

-0.19 

45 

35 

0.41 

0.74 

-1.30 

0.53 

-0.88 

0.57 

1.40 

7 

8 

23394 

0.14 

45 

32 

0.37 

0.84 

-1.05 

0.81 

-0.60 

0.49 

1.32 

7 

9 

23329 

0.97 

45 

26 

0.34 

1.08 

0.67 

1.09 

0.45 

0.41 

0.76 

7 

10 

23175 

1.49 

219 

109 

0.15 

1.11 

1.87 

1.08 

0.84 

0.38 

0.72 

7 

11 

2NBT613 

-1.37 

66 

62 

0.54 

1.12 

0.41 

0.83 

0.11 

0.21 

0.94 

7 

12 

21709 

-1.00 

45 

40 

0.51 

1.02 

0.16 

1.06 

0.30 

0.29 

0.96 

7 

13 

21623 

-0.78 

45 

39 

0.47 

1.05 

0.26 

1.25 

0.59 

0.25 

0.92 

7 

14 

2NBT820 

-0.59 

67 

58 

0.39 

0.91 

-0.30 

0.55 

-0.74 

0.44 

1.13 

7 

15 

2NBT93 

0.05 

80 

68 

0.35 

0.83 

-0.81 

0.58 

-1.00 

0.50 

1.19 

7 

16 

2NBT66 

0.72 

75 

47 

0.26 

1.08 

0.90 

1.19 

1.36 

0.23 

0.68 

7 

17 

2NBT720 

1.72 

75 

31 

0.25 

1.00 

0.08 

0.98 

-0.16 

0.36 

1.00 

7 

18 

22138 

-0.60 

45 

39 

0.47 

0.89 

-0.29 

0.53 

-0.73 

0.44 

1.16 

7 

19 

22168 

-0.42 

46 

37 

0.41 

0.78 

-1.02 

0.66 

-0.67 

0.53 

1.27 

7 

20 

22077 

-0.12 

46 

36 

0.41 

0.94 

-0.21 

0.85 

-0.25 

0.45 

1.08 

7 

21 

22267 

0.04 

45 

34 

0.39 

1.03 

0.20 

1.29 

0.88 

0.41 

0.91 

7 

22 

22393 

0.20 

46 

30 

0.38 

0.87 

-0.71 

0.85 

-0.38 

0.60 

1.20 

7 

23 

20A336 

0.32 

75 

53 

0.28 

1.11 

0.89 

1.09 

0.48 

0.31 

0.81 

7 

24 

22348 

0.65 

45 

29 

0.35 

1.01 

0.10 

0.92 

-0.27 

0.45 

1.02 

7 

25 

22205 

1.41 

45 

25 

0.37 

1.00 

0.07 

0.99 

0.06 

0.56 

0.99 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

8 

1 

2G236 

-1.54 

67 

64 

0.61 

1.02 

0.20 

0.99 

0.33 

0.20 

0.97 

8 

2 

2G31 

-1.26 

86 

79 

0.41 

1.01 

0.14 

0.71 

-0.40 

0.26 

1.02 

8 

3 

2G38 

0.32 

83 

60 

0.26 

1.23 

1.78 

1.41 

1.62 

0.13 

0.53 

8 

4 

23050 

-0.99 

233 

205 

0.21 

1.01 

0.14 

1.07 

0.34 

0.26 

0.97 

8 

5 

23380 

-0.52 

45 

36 

0.42 

0.95 

-0.13 

0.68 

-0.59 

0.48 

1.12 

8 

6 

23069 

-0.43 

44 

36 

0.46 

1.22 

0.82 

1.18 

0.48 

0.36 

0.77 

8 

7 

23105 

-0.17 

46 

36 

0.41 

0.96 

-0.13 

0.93 

-0.01 

0.45 

1.04 

8 

8 

2MD612 

0.11 

67 

56 

0.37 

0.94 

-0.19 

0.68 

-0.72 

0.45 

1.10 

8 

9 

2MD21 

0.98 

78 

45 

0.26 

0.98 

-0.20 

0.95 

-0.25 

0.45 

1.07 

8 

10 

23280 

1.40 

45 

19 

0.36 

0.72 

-1.94 

0.62 

-1.62 

0.69 

1.59 

8 

11 

21639 

-1.38 

46 

41 

0.52 

1.06 

0.29 

0.80 

0.03 

0.36 

0.97 

8 

12 

2NBT213 

-1.00 

76 

67 

0.37 

0.85 

-0.54 

1.21 

0.57 

0.35 

1.09 

8 

13 

21592 

-0.78 

46 

39 

0.45 

0.80 

-0.72 

0.94 

0.11 

0.48 

1.16 

8 

14 

21579 

-0.66 

45 

35 

0.41 

1.03 

0.19 

0.89 

-0.16 

0.44 

1.00 

8 

15 

21612 

0.04 

45 

32 

0.38 

0.83 

-0.87 

1.24 

0.70 

0.54 

1.15 

8 

16 

2NBT26 

0.80 

67 

46 

0.31 

0.81 

-1.24 

0.74 

-0.98 

0.58 

1.29 

8 

17 

21861 

1.70 

44 

20 

0.39 

0.87 

-0.70 

0.92 

-0.19 

0.66 

1.18 

8 

18 

22080 

-0.63 

44 

35 

0.44 

1.36 

1.39 

1.40 

0.82 

0.31 

0.61 

8 

19 

22116 

-0.43 

45 

35 

0.40 

1.06 

0.35 

1.05 

0.26 

0.36 

0.90 

8 

20 

20A413 

-0.12 

80 

63 

0.29 

1.02 

0.15 

0.99 

0.06 

0.32 

0.99 

8 

21 

20A25 

0.05 

80 

61 

0.28 

0.90 

-0.70 

0.72 

-1.03 

0.45 

1.20 

8 

22 

22339 

0.20 

49 

35 

0.36 

0.80 

-1.21 

1.09 

0.36 

0.55 

1.26 

8 

23 

22303 

0.30 

43 

29 

0.38 

1.07 

0.48 

1.22 

0.75 

0.44 

0.81 

8 

24 

22166 

0.60 

46 

27 

0.35 

0.65 

-2.63 

0.54 

-2.07 

0.71 

1.76 

8 

25 

22368 

1.40 

45 

24 

0.36 

1.04 

0.32 

1.12 

0.54 

0.52 

0.85 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

9 

1 

2G318 

-1.46 

83 

77 

0.44 

0.89 

-0.22 

0.56 

-0.64 

0.34 

1.09 

9 

2 

2G231 

-1.22 

83 

75 

0.39 

1.10 

0.42 

1.32 

0.80 

0.13 

0.93 

9 

3 

2G338 

0.29 

81 

57 

0.26 

1.00 

0.01 

0.91 

-0.49 

0.37 

1.04 

9 

4 

23362 

-0.97 

45 

38 

0.47 

1.01 

0.13 

0.61 

-0.34 

0.46 

1.06 

9 

5 

23356 

-0.52 

187 

158 

0.22 

0.82 

-1.40 

0.81 

-0.61 

0.47 

1.17 

9 

6 

23034 

-0.43 

45 

36 

0.43 

1.00 

0.07 

1.20 

0.51 

0.45 

0.97 

9 

7 

23073 

-0.19 

46 

36 

0.40 

1.07 

0.40 

0.99 

0.12 

0.39 

0.92 

9 

8 

23240 

0.14 

45 

32 

0.38 

0.85 

-0.85 

0.71 

-0.91 

0.56 

1.30 

9 

9 

23304 

0.99 

44 

26 

0.38 

0.80 

-1.07 

0.87 

-0.40 

0.66 

1.29 

9 

10 

2MD103 

1.51 

69 

41 

0.28 

0.77 

-2.15 

0.71 

-1.76 

0.63 

1.55 

9 

11 

21656 

-1.38 

45 

40 

0.50 

0.88 

-0.25 

0.57 

-0.50 

0.40 

1.12 

9 

12 

2NBT212 

-0.98 

82 

73 

0.37 

0.93 

-0.21 

0.67 

-0.59 

0.35 

1.08 

9 

13 

21699 

-0.78 

45 

40 

0.50 

1.06 

0.29 

0.74 

-0.17 

0.27 

1.00 

9 

14 

21714 

-0.66 

44 

36 

0.46 

0.94 

-0.15 

0.80 

-0.01 

0.49 

1.08 

9 

15 

2NBT311 

0.05 

80 

68 

0.35 

0.90 

-0.42 

0.86 

-0.19 

0.43 

1.08 

9 

16 

2NBT714 

0.81 

135 

94 

0.22 

1.07 

0.66 

0.94 

-0.21 

0.47 

0.94 

9 

17 

21799 

1.69 

46 

22 

0.36 

0.65 

-2.56 

0.52 

-2.12 

0.74 

1.73 

9 

18 

22197 

-0.64 

45 

37 

0.45 

1.10 

0.46 

1.25 

0.61 

0.36 

0.86 

9 

19 

22264 

-0.43 

45 

35 

0.42 

0.89 

-0.44 

0.93 

0.04 

0.50 

1.08 

9 

20 

20A219 

-0.11 

85 

68 

0.29 

0.79 

-1.38 

0.59 

-1.54 

0.52 

1.29 

9 

21 

22055 

0.04 

44 

34 

0.41 

0.97 

-0.06 

0.90 

-0.09 

0.45 

1.04 

9 

22 

20A38 

0.21 

66 

53 

0.35 

0.86 

-0.76 

0.69 

-0.58 

0.52 

1.18 

9 

23 

22290 

0.31 

45 

31 

0.37 

1.01 

0.10 

1.14 

0.56 

0.45 

0.94 

9 

24 

22338 

0.60 

45 

31 

0.37 

0.80 

-1.30 

0.65 

-1.13 

0.60 

1.44 

9 

25 

22387 

1.40 

45 

23 

0.34 

0.74 

-2.17 

0.65 

-1.78 

0.64 

1.74 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

10 

1 

2G325 

-1.44 

86 

80 

0.44 

1.02 

0.18 

1.01 

0.23 

0.20 

0.98 

10 

2 

2G128 

-1.31 

72 

68 

0.53 

1.08 

0.32 

1.03 

0.32 

0.17 

0.95 

10 

3 

2G133 

0.62 

92 

66 

0.26 

1.08 

0.70 

1.00 

0.05 

0.36 

0.89 

10 

4 

23331 

-0.96 

45 

38 

0.45 

0.97 

-0.01 

0.84 

-0.07 

0.38 

1.04 

10 

5 

23163 

-0.59 

45 

36 

0.43 

1.03 

0.21 

0.73 

-0.33 

0.45 

1.03 

10 

6 

23377 

-0.42 

43 

35 

0.44 

0.77 

-0.91 

0.50 

-1.10 

0.54 

1.30 

10 

7 

23056 

-0.17 

45 

34 

0.39 

1.00 

0.08 

0.97 

0.06 

0.38 

1.00 

10 

8 

2MD77 

0.10 

70 

52 

0.30 

1.08 

0.58 

1.05 

0.29 

0.34 

0.88 

10 

9 

23332 

0.90 

45 

28 

0.34 

1.03 

0.27 

1.12 

0.61 

0.38 

0.88 

10 

10 

2MD414 

1.50 

77 

37 

0.26 

0.93 

-0.71 

0.87 

-0.89 

0.51 

1.23 

10 

11 

2NBT82 

-1.39 

141 

131 

0.34 

1.03 

0.22 

0.91 

0.02 

0.24 

0.99 

10 

12 

21515 

-0.98 

46 

40 

0.50 

1.10 

0.42 

1.48 

0.82 

0.33 

0.85 

10 

13 

21791 

-0.78 

45 

36 

0.42 

0.75 

-1.14 

0.60 

-0.66 

0.55 

1.30 

10 

14 

21728 

-0.66 

45 

35 

0.42 

1.04 

0.23 

0.75 

-0.36 

0.47 

1.03 

10 

15 

21603 

0.06 

44 

33 

0.41 

0.76 

-1.24 

0.63 

-0.88 

0.63 

1.34 

10 

16 

2NBT76 

0.80 

67 

46 

0.31 

1.05 

0.39 

0.90 

-0.28 

0.47 

0.97 

10 

17 

21820 

1.68 

45 

22 

0.36 

1.20 

1.34 

1.15 

0.56 

0.46 

0.58 

10 

18 

22123 

-0.64 

46 

37 

0.44 

1.31 

1.19 

1.21 

0.54 

0.35 

0.71 

10 

19 

22379 

-0.43 

45 

35 

0.40 

0.94 

-0.23 

0.86 

-0.12 

0.47 

1.08 

10 

20 

20A312 

-0.11 

85 

68 

0.29 

0.94 

-0.32 

0.95 

-0.08 

0.38 

1.06 

10 

21 

22085 

0.04 

45 

33 

0.38 

1.02 

0.17 

0.90 

-0.18 

0.44 

1.00 

10 

22 

22399 

0.21 

45 

30 

0.38 

1.25 

1.25 

1.12 

0.43 

0.42 

0.69 

10 

23 

22213 

0.31 

47 

30 

0.36 

0.90 

-0.58 

0.73 

-0.88 

0.59 

1.24 

10 

24 

20A35 

0.60 

73 

48 

0.26 

1.08 

0.84 

1.22 

1.40 

0.22 

0.71 

10 

25 

22202 

1.60 

45 

21 

0.36 

1.20 

1.25 

1.36 

1.32 

0.44 

0.57 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMF 

1 

2G213 

-1.68 

84 

79 

0.48 

1.00 

0.13 

0.63 

-0.35 

0.25 

1.03 

BMF 

2 

2G335 

-0.98 

84 

75 

0.37 

0.87 

-0.44 

0.69 

-0.44 

0.38 

1.11 

BMF 

3 

2G230 

0.45 

98 

75 

0.27 

1.11 

0.83 

0.98 

0.00 

0.36 

0.89 

BMF 

4 

23018 

-0.95 

51 

46 

0.51 

1.01 

0.14 

0.70 

-0.14 

0.35 

1.03 

BMF 

5 

23158 

-0.53 

45 

37 

0.44 

0.77 

-0.94 

0.61 

-0.63 

0.52 

1.27 

BMF 

6 

23283 

-0.47 

44 

36 

0.45 

0.85 

-0.56 

0.56 

-0.69 

0.54 

1.21 

BMF 

7 

23373 

-0.17 

2501 

1902 

0.05 

0.96 

-1.31 

0.97 

-0.53 

0.47 

1.05 

BMF 

8 

2MD1010 

0.10 

72 

51 

0.29 

0.90 

-0.78 

0.75 

-0.97 

0.49 

1.23 

BMF 

9 

2MD56 

0.92 

69 

43 

0.27 

0.92 

-0.67 

0.82 

-1.04 

0.50 

1.24 

BMF 

10 

23234 

1.45 

42 

19 

0.36 

1.07 

0.52 

1.21 

0.85 

0.43 

0.77 

BMF 

11 

21687 

-1.32 

45 

39 

0.50 

0.90 

-0.21 

0.53 

-0.54 

0.49 

1.13 

BMF 

12 

2NBT315 

-1.00 

69 

62 

0.41 

0.91 

-0.20 

0.52 

-0.87 

0.37 

1.11 

BMF 

13 

21634 

-0.76 

44 

38 

0.47 

0.80 

-0.66 

0.52 

-0.64 

0.43 

1.23 

BMF 

14 

21569 

-0.61 

44 

37 

0.45 

0.92 

-0.23 

0.60 

-0.55 

0.43 

1.14 

BMF 

15 

2NBT35 

0.04 

91 

73 

0.29 

0.80 

-1.29 

0.63 

-1.26 

0.52 

1.26 

BMF 

16 

2NBT67 

0.76 

85 

56 

0.25 

0.94 

-0.58 

0.85 

-0.86 

0.47 

1.17 

BMF 

17 

21894 

1.67 

44 

18 

0.37 

0.86 

-0.82 

0.83 

-0.56 

0.62 

1.26 

BMF 

18 

2OA210 

-0.64 

90 

79 

0.34 

1.06 

0.35 

0.93 

0.00 

0.27 

0.97 

BMF 

19 

20A431 

-0.36 

69 

54 

0.32 

0.88 

-0.76 

0.65 

-1.04 

0.46 

1.23 

BMF 

20 

22209 

-0.10 

43 

33 

0.42 

1.04 

0.24 

0.77 

-0.48 

0.52 

1.03 

BMF 

21 

22351 

0.05 

198 

150 

0.18 

1.09 

1.01 

1.01 

0.12 

0.35 

0.89 

BMF 

22 

22265 

0.18 

46 

30 

0.36 

0.75 

-1.60 

0.67 

-1.26 

0.61 

1.45 

BMF 

23 

22183 

0.35 

2521 

1723 

0.05 

0.96 

-1.57 

0.91 

-2.07 

0.51 

1.07 

BMF 

24 

22156 

0.62 

45 

28 

0.35 

0.72 

-2.03 

0.61 

-1.71 

0.68 

1.60 

BMF 

25 

22344 

1.56 

44 

19 

0.35 

0.77 

-1.73 

0.71 

-1.63 

0.61 

1.61 

BMF 

26 

3NF29 

-1.15 

106 

98 

0.39 

0.98 

0.03 

1.12 

0.39 

0.26 

1.00 

BMF 

27 

3G119 

-0.69 

225 

202 

0.23 

0.90 

-0.55 

0.68 

-1.12 

0.37 

1.09 

BMF 

28 

3NBT13 

0.24 

117 

91 

0.24 

0.86 

-1.18 

0.67 

-1.33 

0.47 

1.24 

BMF 

29 

3MD26 

0.81 

117 

80 

0.22 

0.89 

-1.24 

0.77 

-1.27 

0.49 

1.27 

BMF 

30 

3NF317 

1.44 

106 

56 

0.22 

0.90 

-1.15 

0.81 

-1.41 

0.55 

1.29 

Note.  BMF  = Benchmark  Fall. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMW 

1 

2G26 

-1.68 

84 

79 

0.48 

1.02 

0.17 

1.11 

0.38 

0.17 

0.96 

BMW 

2 

2G18 

-1.01 

74 

65 

0.38 

1.22 

0.92 

1.25 

0.62 

0.13 

0.81 

BMW 

3 

2G230 

0.45 

98 

75 

0.27 

1.11 

0.83 

0.98 

0.00 

0.36 

0.89 

BMW 

4 

23275 

-0.95 

46 

39 

0.45 

0.74 

-0.95 

0.72 

-0.31 

0.50 

1.23 

BMW 

5 

23057 

-0.53 

44 

36 

0.44 

0.72 

-1.12 

0.64 

-0.62 

0.61 

1.27 

BMW 

6 

23103 

-0.47 

45 

36 

0.42 

0.88 

-0.46 

0.61 

-0.82 

0.51 

1.20 

BMW 

7 

23373 

-0.17 

2501 

1902 

0.05 

0.96 

-1.31 

0.97 

-0.53 

0.47 

1.05 

BMW 

8 

2MD313 

0.10 

83 

63 

0.28 

0.96 

-0.27 

0.84 

-0.56 

0.40 

1.09 

BMW 

9 

2MD52 

0.92 

76 

45 

0.26 

0.87 

-1.31 

0.87 

-0.79 

0.51 

1.33 

BMW 

10 

23308 

1.45 

44 

22 

0.35 

1.06 

0.52 

1.41 

1.69 

0.41 

0.65 

BMW 

11 

21529 

-1.32 

197 

180 

0.27 

0.94 

-0.24 

0.61 

-0.83 

0.35 

1.07 

BMW 

12 

2NBT218 

-1.00 

98 

90 

0.39 

0.87 

-0.41 

0.54 

-0.80 

0.41 

1.11 

BMW 

13 

21510 

-0.76 

45 

35 

0.41 

0.87 

-0.55 

0.71 

-0.63 

0.51 

1.19 

BMW 

14 

2NBT31 

-0.61 

82 

70 

0.33 

0.81 

-0.87 

0.76 

-0.52 

0.44 

1.16 

BMW 

15 

2NBT813 

0.04 

84 

65 

0.28 

0.84 

-1.09 

0.63 

-1.26 

0.51 

1.26 

BMW 

16 

21883 

0.76 

45 

27 

0.36 

1.04 

0.29 

0.96 

-0.08 

0.50 

0.95 

BMW 

17 

21812 

1.67 

45 

20 

0.37 

0.80 

-1.19 

0.85 

-0.43 

0.65 

1.33 

BMW 

18 

2OA210 

-0.64 

90 

79 

0.34 

1.06 

0.35 

0.93 

0.00 

0.27 

0.97 

BMW 

19 

20A431 

-0.36 

69 

54 

0.32 

0.88 

-0.76 

0.65 

-1.04 

0.46 

1.23 

BMW 

20 

22075 

-0.10 

45 

33 

0.38 

1.00 

0.05 

0.83 

-0.30 

0.46 

1.05 

BMW 

21 

22351 

0.05 

198 

150 

0.18 

1.09 

1.01 

1.01 

0.12 

0.35 

0.89 

BMW 

22 

22112 

0.18 

45 

31 

0.38 

0.98 

-0.03 

0.85 

-0.36 

0.51 

1.07 

BMW 

23 

22215 

0.35 

43 

29 

0.38 

0.97 

-0.15 

1.12 

0.48 

0.48 

0.99 

BMW 

24 

22327 

0.62 

198 

134 

0.17 

0.95 

-0.72 

0.91 

-0.55 

0.47 

1.10 

BMW 

25 

22181 

1.56 

45 

22 

0.34 

1.01 

0.10 

0.97 

-0.07 

0.47 

1.00 

BMW 

26 

3NF26 

-1.10 

123 

116 

0.40 

0.91 

-0.18 

0.57 

-0.60 

0.33 

1.08 

BMW 

27 

3G17 

-0.69 

108 

97 

0.35 

1.12 

0.58 

1.23 

0.58 

0.26 

0.88 

BMW 

28 

3NBT229 

0.24 

111 

93 

0.28 

0.90 

-0.54 

0.77 

-0.60 

0.41 

1.11 

BMW 

29 

3MD87 

0.82 

107 

78 

0.25 

1.16 

1.26 

1.04 

0.26 

0.41 

0.81 

BMW 

30 

3NF265 

1.42 

120 

71 

0.21 

1.01 

0.15 

0.96 

-0.25 

0.44 

1.01 

Note.  BMW  = Benchmark  Winter. 
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Appendix  B:  Item  Statistics  by  Test  Form 


Item 


Form 

Number 

Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMS 

1 

2G36 

-1.66 

72 

67 

0.48 

1.02 

0.17 

1.25 

0.55 

0.19 

0.96 

BMS 

2 

2G327 

-1.02 

68 

62 

0.46 

0.86 

-0.34 

1.22 

0.53 

0.34 

1.03 

BMS 

3 

2G320 

0.43 

72 

47 

0.28 

1.27 

2.10 

1.25 

1.16 

0.29 

0.45 

BMS 

4 

23340 

-0.95 

45 

38 

0.46 

0.94 

-0.13 

1.15 

0.44 

0.38 

0.99 

BMS 

5 

23333 

-0.53 

45 

35 

0.41 

0.86 

-0.63 

0.70 

-0.55 

0.51 

1.20 

BMS 

6 

23110 

-0.47 

46 

38 

0.43 

0.87 

-0.41 

0.75 

-0.38 

0.49 

1.13 

BMS 

7 

23186 

-0.17 

47 

35 

0.37 

0.96 

-0.14 

1.24 

0.69 

0.40 

0.98 

BMS 

8 

2MD1014 

0.10 

80 

59 

0.27 

0.98 

-0.10 

0.91 

-0.42 

0.37 

1.05 

BMS 

9 

2MD52 

0.92 

76 

45 

0.26 

0.87 

-1.31 

0.87 

-0.79 

0.51 

1.33 

BMS 

10 

23308 

1.45 

44 

22 

0.35 

1.06 

0.52 

1.41 

1.69 

0.41 

0.65 

BMS 

11 

21529 

-1.32 

197 

180 

0.27 

0.94 

-0.24 

0.61 

-0.83 

0.35 

1.07 

BMS 

12 

2NBT814 

-1.00 

69 

62 

0.41 

1.00 

0.11 

0.76 

-0.29 

0.27 

1.02 

BMS 

13 

21549 

-0.76 

45 

38 

0.45 

0.89 

-0.33 

0.83 

-0.06 

0.41 

1.09 

BMS 

14 

2NBT31 

-0.61 

82 

70 

0.33 

0.81 

-0.87 

0.76 

-0.52 

0.44 

1.16 

BMS 

15 

2NBT810 

0.04 

76 

57 

0.29 

0.80 

-1.48 

0.64 

-1.44 

0.53 

1.35 

BMS 

16 

2NBT33 

0.76 

66 

50 

0.33 

1.00 

0.03 

0.99 

0.08 

0.44 

1.00 

BMS 

17 

21886 

1.67 

45 

19 

0.34 

0.85 

-1.11 

0.88 

-0.48 

0.53 

1.33 

BMS 

18 

22189 

-0.64 

45 

37 

0.44 

1.02 

0.16 

1.07 

0.30 

0.39 

0.96 

BMS 

19 

22070 

-0.36 

43 

35 

0.43 

1.02 

0.18 

1.16 

0.45 

0.33 

0.95 

BMS 

20 

20A321 

-0.10 

75 

58 

0.30 

1.02 

0.16 

0.86 

-0.42 

0.36 

1.02 

BMS 

21 

22229 

0.05 

45 

31 

0.39 

1.07 

0.43 

1.12 

0.41 

0.49 

0.87 

BMS 

22 

22112 

0.18 

45 

31 

0.38 

0.98 

-0.03 

0.85 

-0.36 

0.51 

1.07 

BMS 

23 

22110 

0.35 

43 

30 

0.40 

0.85 

-0.79 

1.21 

0.64 

0.56 

1.16 

BMS 

24 

22308 

0.62 

46 

26 

0.36 

1.03 

0.25 

1.00 

0.08 

0.54 

0.96 

BMS 

25 

22316 

1.56 

45 

24 

0.37 

1.01 

0.09 

1.01 

0.13 

0.57 

0.98 

BMS 

26 

3NF28 

-1.08 

111 

103 

0.39 

0.95 

-0.08 

0.63 

-0.45 

0.31 

1.05 

BMS 

27 

3G211 

-0.69 

108 

97 

0.35 

0.89 

-0.44 

0.77 

-0.29 

0.40 

1.10 

BMS 

28 

3NBT321 

0.25 

106 

83 

0.26 

0.97 

-0.16 

0.75 

-1.04 

0.44 

1.09 

BMS 

29 

3MD25 

0.83 

127 

88 

0.22 

0.80 

-2.14 

0.65 

-2.06 

0.60 

1.39 

BMS 

30 

3NF280 

1.40 

116 

70 

0.21 

0.96 

-0.50 

0.90 

-0.78 

0.44 

1.15 

Note.  BMS  = Benchmark  Spring. 


easyCBM  CCSS  Second  Grade  Math  Measure  Development 


85 

Appendix  C:  Distractor  by  Test  Form 


Appendix  C:  Distractor  Statistics  by  Test  Form 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

1 

2G13 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.03 

1 

1 

2G13 

A 

1 

65 

94 

1.97 

0.18 

1.01 

0.23 

1 

1 

2G13 

B 

0 

3 

4 

0.92 

0.45 

0.99 

-0.14 

1 

1 

2G13 

C 

0 

1 

1 

-0.60 

0.00 

0.18 

-0.21 

1 

1 

2G13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

2 

2G331 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

1 

2 

2G331 

A 

1 

75 

90 

1.57 

0.12 

1.01 

0.24 

1 

2 

2G331 

B 

0 

6 

7 

1.13 

0.18 

1.10 

-0.10 

1 

2 

2G331 

C 

0 

2 

2 

-0.43 

0.46 

0.24 

-0.29 

1 

2 

2G331 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

3 

2G115 

* 

-1 

3924 

98 

1.50 

0.02 

0.00 

-0.06 

1 

3 

2G115 

A 

1 

53 

78 

2.53 

0.18 

1.00 

0.43 

1 

3 

2G115 

B 

0 

15 

22 

1.13 

0.26 

0.84 

-0.43 

1 

3 

2G115 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

3 

2G115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

4 

23123 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

1 

4 

23123 

A 

1 

40 

87 

1.59 

0.20 

1.01 

0.30 

1 

4 

23123 

B 

0 

1 

2 

1.13 

0.00 

1.24 

-0.04 

1 

4 

23123 

C 

0 

5 

11 

0.29 

0.51 

0.87 

-0.31 

1 

4 

23123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

5 

23374 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

1 

5 

23374 

A 

1 

34 

77 

1.67 

0.26 

0.87 

0.51 

1 

5 

23374 

B 

0 

1 

2 

0.20 

0.00 

0.68 

-0.09 

1 

5 

23374 

C 

0 

1 

2 

-0.30 

0.00 

0.41 

-0.14 

1 

5 

23374 

D 

0 

8 

18 

-0.49 

0.58 

0.80 

-0.47 

1 

6 

23112 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

1 

6 

23112 

A 

1 

36 

80 

1.74 

0.23 

0.79 

0.47 

1 

6 

23112 

B 

0 

1 

2 

-1.56 

0.00 

0.09 

-0.28 

1 

6 

23112 

C 

0 

4 

9 

0.15 

0.41 

0.63 

-0.24 

1 

6 

23112 

D 

0 

4 

9 

-0.06 

1.26 

1.15 

-0.28 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

7 

23357 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

1 

7 

23357 

A 

1 

33 

72 

1.93 

0.28 

0.77 

0.58 

1 

7 

23357 

B 

0 

4 

9 

0.44 

0.92 

1.80 

-0.13 

1 

7 

23357 

C 

0 

7 

15 

-0.46 

0.39 

0.49 

-0.38 

1 

7 

23357 

D 

0 

2 

4 

-2.44 

0.37 

0.05 

-0.42 

1 

8 

23338 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

1 

8 

23338 

A 

1 

30 

67 

1.53 

0.22 

1.02 

0.46 

1 

8 

23338 

B 

0 

5 

11 

0.65 

0.68 

1.84 

-0.08 

1 

8 

23338 

C 

0 

6 

13 

0.63 

0.28 

0.97 

-0.09 

1 

8 

23338 

D 

0 

4 

9 

-1.91 

1.21 

0.32 

-0.57 

1 

9 

2MD104 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

1 

9 

2MD104 

A 

1 

47 

69 

2.62 

0.17 

0.79 

0.61 

1 

9 

2MD104 

B 

0 

12 

18 

0.91 

0.36 

1.05 

-0.37 

1 

9 

2MD104 

C 

0 

9 

13 

0.54 

0.25 

0.39 

-0.41 

1 

9 

2MD104 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

10 

23294 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

1 

10 

23294 

A 

1 

24 

53 

2.85 

0.28 

0.57 

0.71 

1 

10 

23294 

B 

0 

7 

16 

0.06 

0.30 

0.31 

-0.43 

1 

10 

23294 

C 

0 

12 

27 

0.79 

0.30 

0.78 

-0.34 

1 

10 

23294 

D 

0 

2 

4 

-0.02 

0.49 

0.25 

-0.23 

1 

11 

21568 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

1 

11 

21568 

A 

1 

39 

89 

1.61 

0.24 

0.92 

0.39 

1 

11 

21568 

B 

0 

3 

7 

-0.29 

0.71 

0.64 

-0.30 

1 

11 

21568 

C 

0 

2 

5 

-0.26 

0.12 

0.40 

-0.24 

1 

11 

21568 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

12 

21521 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

1 

12 

21521 

A 

1 

39 

85 

1.66 

0.21 

0.77 

0.49 

1 

12 

21521 

B 

0 

2 

4 

-0.04 

0.83 

0.68 

-0.20 

1 

12 

21521 

C 

0 

3 

7 

-0.06 

1.27 

2.05 

-0.25 

1 

12 

21521 

D 

0 

2 

4 

-1.08 

0.80 

0.24 

-0.35 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

13 

2NBT918 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

1 

13 

2NBT918 

A 

1 

60 

86 

1.57 

0.14 

0.99 

0.30 

1 

13 

2NBT918 

B 

0 

5 

7 

0.26 

0.31 

0.55 

-0.29 

1 

13 

2NBT918 

C 

0 

5 

7 

0.97 

0.60 

1.63 

-0.11 

1 

13 

2NBT918 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

14 

2NBT63 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

1 

14 

2NBT63 

A 

1 

72 

86 

1.72 

0.14 

1.02 

0.29 

1 

14 

2NBT63 

B 

0 

5 

6 

1.11 

0.29 

1.09 

-0.10 

1 

14 

2NBT63 

C 

0 

7 

8 

0.48 

0.32 

0.65 

-0.29 

1 

14 

2NBT63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

15 

2NBT38 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

1 

15 

2NBT38 

A 

1 

57 

75 

1.74 

0.15 

0.90 

0.47 

1 

15 

2NBT38 

B 

0 

12 

16 

0.15 

0.15 

0.42 

-0.48 

1 

15 

2NBT38 

C 

0 

7 

9 

1.07 

0.24 

1.10 

-0.10 

1 

15 

2NBT38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

16 

2NBT610 

* 

-1 

3839 

96 

1.51 

0.02 

0.00 

-0.01 

1 

16 

2NBT610 

A 

1 

104 

68 

1.99 

0.10 

0.85 

0.54 

1 

16 

2NBT610 

B 

0 

27 

18 

0.92 

0.15 

0.86 

-0.27 

1 

16 

2NBT610 

C 

0 

22 

14 

0.42 

0.13 

0.45 

-0.43 

1 

16 

2NBT610 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

17 

21893 

* 

-1 

3937 

99 

1.52 

0.02 

0.00 

0.00 

1 

17 

21893 

A 

1 

24 

44 

2.25 

0.26 

0.94 

0.50 

1 

17 

21893 

B 

0 

3 

5 

0.77 

0.21 

0.50 

-0.13 

1 

17 

21893 

C 

0 

26 

47 

1.04 

0.22 

1.07 

-0.33 

1 

17 

21893 

D 

0 

2 

4 

-0.41 

0.43 

0.16 

-0.28 

1 

18 

20A236 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

1 

18 

20A236 

A 

1 

62 

90 

2.11 

0.14 

0.97 

0.29 

1 

18 

20A236 

B 

0 

2 

3 

1.69 

1.59 

2.96 

-0.05 

1 

18 

20A236 

C 

0 

5 

7 

0.76 

0.35 

0.56 

-0.31 

1 

18 

20A236 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

19 

2OA340 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

1 

19 

2OA340 

A 

1 

84 

87 

2.08 

0.11 

0.96 

0.36 

1 

19 

2OA340 

B 

0 

2 

2 

0.36 

0.35 

0.34 

-0.20 

1 

19 

2OA340 

C 

0 

11 

11 

0.97 

0.40 

1.52 

-0.30 

1 

19 

2OA340 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

20 

22108 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

1 

20 

22108 

A 

1 

34 

76 

2.02 

0.25 

0.84 

0.52 

1 

20 

22108 

B 

0 

3 

7 

-0.27 

0.31 

0.32 

-0.31 

1 

20 

22108 

C 

0 

2 

4 

0.64 

1.96 

2.63 

-0.12 

1 

20 

22108 

D 

0 

6 

13 

0.13 

0.33 

0.53 

-0.35 

1 

21 

22052 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

1 

21 

22052 

A 

1 

33 

75 

1.97 

0.20 

0.75 

0.61 

1 

21 

22052 

B 

0 

4 

9 

0.18 

0.24 

0.43 

-0.27 

1 

21 

22052 

C 

0 

3 

7 

0.74 

0.10 

0.69 

-0.13 

1 

21 

22052 

D 

0 

4 

9 

-1.08 

0.97 

0.26 

-0.54 

1 

22 

20A318 

* 

-1 

3903 

98 

1.51 

0.02 

0.00 

-0.03 

1 

22 

20A318 

A 

1 

70 

79 

2.03 

0.14 

1.03 

0.38 

1 

22 

20A318 

B 

0 

13 

15 

1.05 

0.23 

0.89 

-0.27 

1 

22 

20A318 

C 

0 

6 

7 

0.77 

0.31 

0.63 

-0.24 

1 

22 

20A318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

23 

22396 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

1 

23 

22396 

A 

1 

32 

73 

2.06 

0.25 

1.10 

0.44 

1 

23 

22396 

B 

0 

2 

5 

-0.27 

0.27 

0.24 

-0.29 

1 

23 

22396 

C 

0 

5 

11 

1.74 

0.19 

1.87 

0.02 

1 

23 

22396 

D 

0 

5 

11 

-0.12 

0.35 

0.33 

-0.44 

1 

24 

20  A3  4 

* 

-1 

3839 

96 

1.51 

0.02 

0.00 

-0.01 

1 

24 

20  A3  4 

A 

1 

103 

67 

1.90 

0.11 

0.99 

0.42 

1 

24 

20  A3  4 

B 

0 

27 

18 

0.67 

0.14 

0.64 

-0.38 

1 

24 

20A34 

C 

0 

23 

15 

1.19 

0.19 

1.36 

-0.15 

1 

24 

20  A3  4 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

1 

25 

22323 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

1 

25 

22323 

A 

1 

24 

53 

2.50 

0.29 

1.19 

0.52 

1 

25 

22323 

B 

0 

13 

29 

1.16 

0.34 

0.94 

-0.24 

1 

25 

22323 

C 

0 

2 

4 

1.71 

1.01 

1.64 

0.00 

1 

25 

22323 

D 

0 

6 

13 

-0.02 

0.42 

0.26 

-0.45 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

1 

2G142 

* 

-1 

3920 

98 

1.51 

0.02 

0.00 

-0.05 

2 

1 

2G142 

A 

1 

69 

96 

2.14 

0.14 

1.00 

0.26 

2 

1 

2G142 

B 

0 

3 

4 

0.61 

0.17 

0.43 

-0.26 

2 

1 

2G142 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

1 

2G142 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

2 

2G313 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2 

2 

2G313 

A 

1 

61 

91 

2.07 

0.18 

1.00 

0.34 

2 

2 

2G313 

B 

0 

6 

9 

0.31 

0.33 

0.60 

-0.34 

2 

2 

2G313 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

2 

2G313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

3 

2G39 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

2 

3 

2G39 

A 

1 

55 

71 

1.72 

0.16 

1.04 

0.40 

2 

3 

2G39 

B 

0 

12 

15 

0.96 

0.24 

1.18 

-0.16 

2 

3 

2G39 

C 

0 

11 

14 

0.37 

0.29 

0.76 

-0.36 

2 

3 

2G39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

4 

23361 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

2 

4 

23361 

A 

1 

38 

86 

1.86 

0.25 

0.86 

0.43 

2 

4 

23361 

B 

0 

1 

2 

-0.42 

0.00 

0.29 

-0.20 

2 

4 

23361 

C 

0 

4 

9 

0.13 

0.49 

0.67 

-0.30 

2 

4 

23361 

D 

0 

1 

2 

-0.62 

0.00 

0.24 

-0.22 

2 

5 

23063 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

2 

5 

23063 

A 

1 

35 

78 

1.73 

0.26 

0.97 

0.50 

2 

5 

23063 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

5 

23063 

C 

0 

7 

16 

-0.23 

0.34 

0.64 

-0.40 

2 

5 

23063 

D 

0 

3 

7 

-0.22 

1.01 

0.98 

-0.25 

2 

6 

23347 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

2 

6 

23347 

A 

1 

38 

84 

1.85 

0.23 

1.18 

0.26 

2 

6 

23347 

B 

0 

3 

7 

0.56 

0.31 

0.61 

-0.22 

2 

6 

23347 

C 

0 

2 

4 

1.89 

0.26 

2.19 

0.03 

2 

6 

23347 

D 

0 

2 

4 

0.39 

0.46 

0.52 

-0.21 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

7 

23058 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

2 

7 

23058 

A 

1 

32 

73 

1.74 

0.26 

1.01 

0.48 

2 

7 

23058 

B 

0 

3 

7 

-0.92 

0.13 

0.20 

-0.37 

2 

7 

23058 

C 

0 

8 

18 

0.40 

0.53 

1.79 

-0.26 

2 

7 

23058 

D 

0 

1 

2 

-0.15 

0.00 

0.41 

-0.14 

2 

8 

2MD84 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

2 

8 

2MD84 

A 

1 

65 

76 

1.92 

0.13 

0.88 

0.50 

2 

8 

2MD84 

B 

0 

12 

14 

0.61 

0.23 

0.67 

-0.36 

2 

8 

2MD84 

C 

0 

8 

9 

0.58 

0.21 

0.57 

-0.29 

2 

8 

2MD84 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

9 

23077 

* 

-1 

3950 

99 

1.51 

0.02 

0.00 

-0.02 

2 

9 

23077 

A 

1 

26 

62 

2.23 

0.38 

1.46 

0.36 

2 

9 

23077 

B 

0 

7 

17 

1.61 

0.40 

2.67 

-0.03 

2 

9 

23077 

C 

0 

4 

10 

0.86 

0.47 

0.92 

-0.17 

2 

9 

23077 

D 

0 

5 

12 

0.11 

0.22 

0.35 

-0.35 

2 

10 

2MD54 

* 

-1 

3921 

98 

1.52 

0.02 

0.00 

0.02 

2 

10 

2MD54 

A 

1 

33 

46 

2.39 

0.23 

0.64 

0.67 

2 

10 

2MD54 

B 

0 

19 

27 

0.39 

0.13 

0.51 

-0.40 

2 

10 

2MD54 

C 

0 

19 

27 

0.50 

0.23 

0.82 

-0.36 

2 

10 

2MD54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

11 

2NBT319 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2 

11 

2NBT319 

A 

1 

65 

94 

2.07 

0.14 

0.98 

0.23 

2 

11 

2NBT319 

B 

0 

1 

1 

2.14 

0.00 

1.92 

0.01 

2 

11 

2NBT319 

C 

0 

3 

4 

0.52 

0.51 

0.47 

-0.28 

2 

11 

2NBT319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

12 

2NBT815 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

2 

12 

2NBT815 

A 

1 

89 

92 

2.03 

0.11 

0.94 

0.35 

2 

12 

2NBT815 

B 

0 

5 

5 

0.90 

0.59 

1.13 

-0.21 

2 

12 

2NBT815 

C 

0 

3 

3 

0.16 

0.34 

0.32 

-0.28 

2 

12 

2NBT815 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

13 

21628 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

2 

13 

21628 

A 

1 

38 

86 

1.83 

0.19 

0.89 

0.45 

2 

13 

21628 

B 

0 

2 

5 

1.03 

0.11 

0.97 

-0.10 

2 

13 

21628 

C 

0 

3 

7 

-0.71 

0.27 

0.18 

-0.49 

2 

13 

21628 

D 

0 

1 

2 

0.94 

0.00 

0.88 

-0.08 

2 

14 

21588 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

2 

14 

21588 

A 

1 

37 

84 

2.04 

0.26 

0.93 

0.45 

2 

14 

21588 

B 

0 

3 

7 

0.26 

0.50 

0.67 

-0.24 

2 

14 

21588 

C 

0 

1 

2 

-1.09 

0.00 

0.14 

-0.26 

2 

14 

21588 

D 

0 

3 

7 

0.18 

0.50 

0.64 

-0.26 

2 

15 

2NBT52 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2 

15 

2NBT52 

A 

1 

65 

77 

1.87 

0.14 

0.89 

0.46 

2 

15 

2NBT52 

B 

0 

16 

19 

0.59 

0.22 

0.72 

-0.42 

2 

15 

2NBT52 

C 

0 

3 

4 

0.64 

0.38 

0.61 

-0.16 

2 

15 

2NBT52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

16 

21873 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

2 

16 

21873 

A 

1 

26 

58 

1.82 

0.24 

0.85 

0.60 

2 

16 

21873 

B 

0 

9 

20 

0.07 

0.38 

0.65 

-0.33 

2 

16 

21873 

C 

0 

2 

4 

1.04 

0.02 

1.09 

0.00 

2 

16 

21873 

D 

0 

8 

18 

-0.30 

0.44 

0.48 

-0.43 

2 

17 

21817 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

2 

17 

21817 

A 

1 

16 

36 

2.17 

0.40 

0.85 

0.55 

2 

17 

21817 

B 

0 

20 

44 

0.75 

0.19 

0.98 

-0.17 

2 

17 

21817 

C 

0 

4 

9 

-1.23 

0.61 

0.15 

-0.46 

2 

17 

21817 

D 

0 

5 

11 

0.38 

0.38 

0.60 

-0.15 

2 

18 

20A332 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2 

18 

20A332 

A 

1 

59 

84 

1.69 

0.13 

0.83 

0.53 

2 

18 

20A332 

B 

0 

8 

11 

-0.01 

0.24 

0.43 

-0.47 

2 

18 

20A332 

C 

0 

3 

4 

0.23 

0.43 

0.54 

-0.23 

2 

18 

20A332 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

19 

22158 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

2 

19 

22158 

A 

1 

36 

80 

2.02 

0.25 

1.08 

0.50 

2 

19 

22158 

B 

0 

3 

7 

-0.11 

0.71 

0.61 

-0.29 

2 

19 

22158 

C 

0 

4 

9 

-0.19 

0.12 

0.34 

-0.35 

2 

19 

22158 

D 

0 

2 

4 

0.60 

0.24 

0.75 

-0.14 

2 

20 

20A222 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

2 

20 

20A222 

A 

1 

57 

86 

2.39 

0.18 

1.12 

0.23 

2 

20 

20A222 

B 

0 

4 

6 

2.15 

0.32 

1.84 

-0.02 

2 

20 

20A222 

C 

0 

5 

8 

0.97 

0.59 

0.97 

-0.28 

2 

20 

20A222 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

21 

20A323 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

2 

21 

20A323 

A 

1 

50 

72 

1.74 

0.21 

0.98 

0.40 

2 

21 

20A323 

B 

0 

11 

16 

0.61 

0.32 

1.30 

-0.23 

2 

21 

20A323 

C 

0 

8 

12 

0.23 

0.34 

0.81 

-0.29 

2 

21 

20A323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

22 

22284 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

2 

22 

22284 

A 

1 

32 

71 

1.59 

0.19 

0.94 

0.43 

2 

22 

22284 

B 

0 

5 

11 

0.83 

0.23 

0.90 

-0.14 

2 

22 

22284 

C 

0 

3 

7 

0.36 

0.78 

0.94 

-0.22 

2 

22 

22284 

D 

0 

5 

11 

0.33 

0.53 

0.71 

-0.30 

2 

23 

22186 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

2 

23 

22186 

A 

1 

33 

73 

2.18 

0.22 

0.96 

0.54 

2 

23 

22186 

B 

0 

2 

4 

-0.10 

0.17 

0.26 

-0.25 

2 

23 

22186 

C 

0 

4 

9 

0.40 

0.98 

1.28 

-0.26 

2 

23 

22186 

D 

0 

6 

13 

0.38 

0.66 

0.91 

-0.33 

2 

24 

22310 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

2 

24 

22310 

A 

1 

28 

62 

1.76 

0.25 

1.01 

0.46 

2 

24 

22310 

B 

0 

6 

13 

0.18 

0.46 

0.66 

-0.34 

2 

24 

22310 

C 

0 

9 

20 

0.80 

0.27 

1.08 

-0.20 

2 

24 

22310 

D 

0 

2 

4 

0.52 

0.22 

0.59 

-0.13 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2 

25 

22357 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

2 

25 

22357 

A 

1 

19 

42 

2.17 

0.27 

0.62 

0.64 

2 

25 

22357 

B 

0 

6 

13 

-0.07 

0.35 

0.40 

-0.34 

2 

25 

22357 

C 

0 

13 

29 

0.65 

0.30 

0.92 

-0.21 

2 

25 

22357 

D 

0 

7 

16 

0.18 

0.40 

0.55 

-0.29 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

1 

2G131 

* 

-1 

3818 

96 

1.51 

0.02 

0.00 

-0.02 

3 

1 

2G131 

A 

1 

164 

94 

1.68 

0.09 

1.06 

0.10 

3 

1 

2G131 

B 

0 

1 

1 

1.01 

0.00 

0.86 

-0.04 

3 

1 

2G131 

C 

0 

9 

5 

1.20 

0.27 

1.35 

-0.09 

3 

1 

2G131 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

2 

2G323 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

3 

2 

2G323 

A 

1 

91 

93 

2.00 

0.11 

1.02 

0.25 

3 

2 

2G323 

B 

0 

5 

5 

0.89 

0.61 

1.40 

-0.21 

3 

2 

2G323 

C 

0 

2 

2 

0.94 

0.08 

0.63 

-0.13 

3 

2 

2G323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

3 

2G319 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

3 

3 

2G319 

A 

1 

51 

65 

1.78 

0.16 

0.99 

0.43 

3 

3 

2G319 

B 

0 

4 

5 

0.06 

0.50 

0.46 

-0.26 

3 

3 

2G319 

C 

0 

23 

29 

0.83 

0.18 

0.97 

-0.32 

3 

3 

2G319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

4 

23197 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

3 

4 

23197 

A 

1 

39 

87 

1.66 

0.25 

1.59 

0.13 

3 

4 

23197 

B 

0 

2 

4 

0.86 

0.57 

1.14 

-0.11 

3 

4 

23197 

C 

0 

3 

7 

1.16 

0.44 

1.54 

-0.08 

3 

4 

23197 

D 

0 

1 

2 

1.39 

0.00 

1.64 

-0.02 

3 

5 

23224 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

3 

5 

23224 

A 

1 

37 

82 

1.62 

0.20 

1.31 

0.41 

3 

5 

23224 

B 

0 

2 

4 

1.05 

0.64 

1.31 

-0.06 

3 

5 

23224 

C 

0 

2 

4 

-0.05 

0.75 

0.47 

-0.25 

3 

5 

23224 

D 

0 

4 

9 

0.08 

0.37 

0.49 

-0.33 

3 

6 

2MD61 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

3 

6 

2MD61 

A 

1 

61 

88 

2.14 

0.13 

0.89 

0.33 

3 

6 

2MD61 

B 

0 

4 

6 

1.11 

0.67 

1.11 

-0.20 

3 

6 

2MD61 

C 

0 

4 

6 

0.86 

0.83 

1.58 

-0.25 

3 

6 

2MD61 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

7 

23370 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

3 

7 

23370 

A 

1 

31 

70 

1.62 

0.27 

0.88 

0.51 

3 

7 

23370 

B 

0 

6 

14 

-0.13 

0.52 

0.80 

-0.30 

3 

7 

23370 

C 

0 

5 

11 

0.05 

0.66 

1.02 

-0.23 

3 

7 

23370 

D 

0 

2 

5 

-0.88 

0.31 

0.23 

-0.27 

3 

8 

23352 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

3 

8 

23352 

A 

1 

30 

67 

1.42 

0.20 

0.90 

0.47 

3 

8 

23352 

B 

0 

9 

20 

0.33 

0.31 

0.79 

-0.29 

3 

8 

23352 

C 

0 

2 

4 

1.10 

0.54 

1.49 

0.01 

3 

8 

23352 

D 

0 

4 

9 

-0.45 

0.68 

0.49 

-0.38 

3 

9 

2MD810 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

3 

9 

2MD810 

A 

1 

59 

74 

2.67 

0.15 

0.91 

0.49 

3 

9 

2MD810 

B 

0 

9 

11 

1.33 

0.42 

1.51 

-0.26 

3 

9 

2MD810 

C 

0 

12 

15 

1.13 

0.31 

0.66 

-0.37 

3 

9 

2MD810 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

10 

2MD315 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

3 

10 

2MD315 

A 

1 

52 

65 

2.69 

0.18 

1.26 

0.42 

3 

10 

2MD315 

B 

0 

23 

29 

1.69 

0.23 

1.24 

-0.29 

3 

10 

2MD315 

C 

0 

5 

6 

0.91 

0.22 

0.36 

-0.27 

3 

10 

2MD315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

11 

2NBT914 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

3 

11 

2NBT914 

A 

1 

65 

94 

2.05 

0.14 

1.06 

0.16 

3 

11 

2NBT914 

B 

0 

2 

3 

1.51 

0.42 

1.12 

-0.07 

3 

11 

2NBT914 

C 

0 

2 

3 

1.04 

0.53 

0.73 

-0.15 

3 

11 

2NBT914 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

12 

2NBT314 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

3 

12 

2NBT314 

A 

1 

75 

89 

1.75 

0.13 

0.87 

0.42 

3 

12 

2NBT314 

B 

0 

3 

4 

0.40 

0.36 

0.54 

-0.20 

3 

12 

2NBT314 

C 

0 

6 

7 

0.06 

0.34 

0.46 

-0.36 

3 

12 

2NBT314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

13 

21573 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

3 

13 

21573 

A 

1 

39 

85 

1.72 

0.22 

1.02 

0.37 

3 

13 

21573 

B 

0 

2 

4 

-0.03 

0.44 

0.43 

-0.23 

3 

13 

21573 

C 

0 

4 

9 

0.71 

0.52 

1.15 

-0.17 

3 

13 

21573 

D 

0 

1 

2 

-1.04 

0.00 

0.14 

-0.27 

3 

14 

21671 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

3 

14 

21671 

A 

1 

37 

82 

1.67 

0.18 

0.78 

0.56 

3 

14 

21671 

B 

0 

3 

7 

-0.03 

0.53 

0.49 

-0.29 

3 

14 

21671 

C 

0 

2 

4 

0.14 

0.55 

0.54 

-0.21 

3 

14 

21671 

D 

0 

3 

7 

-0.49 

0.58 

0.32 

-0.39 

3 

15 

2NBT310 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

3 

15 

2NBT310 

A 

1 

57 

75 

1.68 

0.15 

1.01 

0.39 

3 

15 

2NBT310 

B 

0 

12 

16 

0.27 

0.17 

0.50 

-0.43 

3 

15 

2NBT310 

C 

0 

7 

9 

1.31 

0.19 

1.33 

-0.03 

3 

15 

2NBT310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

16 

2NBT220 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

3 

16 

2NBT220 

A 

1 

58 

68 

1.93 

0.14 

0.97 

0.42 

3 

16 

2NBT220 

B 

0 

12 

14 

0.83 

0.21 

0.75 

-0.28 

3 

16 

2NBT220 

C 

0 

15 

18 

0.97 

0.26 

1.14 

-0.26 

3 

16 

2NBT220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

17 

21862 

* 

-1 

3942 

99 

1.52 

0.02 

0.00 

0.00 

3 

17 

21862 

A 

1 

21 

42 

2.54 

0.44 

1.03 

0.52 

3 

17 

21862 

B 

0 

11 

22 

0.77 

0.23 

0.80 

-0.23 

3 

17 

21862 

C 

0 

15 

30 

1.06 

0.20 

1.07 

-0.17 

3 

17 

21862 

D 

0 

3 

6 

-0.95 

0.31 

0.12 

-0.36 

3 

18 

20A212 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

3 

18 

20A212 

A 

1 

64 

84 

1.62 

0.14 

0.90 

0.39 

3 

18 

20A212 

B 

0 

7 

9 

0.53 

0.42 

1.07 

-0.25 

3 

18 

20A212 

C 

0 

5 

7 

0.15 

0.24 

0.46 

-0.29 

3 

18 

20A212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

19 

22081 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

3 

19 

22081 

A 

1 

35 

78 

1.50 

0.22 

1.09 

0.36 

3 

19 

22081 

B 

0 

3 

7 

0.70 

0.35 

1.00 

-0.11 

3 

19 

22081 

C 

0 

4 

9 

0.67 

0.64 

1.50 

-0.13 

3 

19 

22081 

D 

0 

3 

7 

-0.44 

0.47 

0.34 

-0.34 

3 

20 

22147 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

3 

20 

22147 

A 

1 

33 

75 

1.71 

0.21 

0.80 

0.48 

3 

20 

22147 

B 

0 

4 

9 

-0.23 

0.16 

0.32 

-0.38 

3 

20 

22147 

C 

0 

4 

9 

0.50 

0.67 

1.22 

-0.20 

3 

20 

22147 

D 

0 

3 

7 

0.51 

0.89 

1.31 

-0.17 

3 

21 

22279 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

3 

21 

22279 

A 

1 

33 

73 

1.73 

0.22 

0.94 

0.46 

3 

21 

22279 

B 

0 

3 

7 

-0.20 

0.45 

0.36 

-0.32 

3 

21 

22279 

C 

0 

1 

2 

1.60 

0.00 

1.83 

0.03 

3 

21 

22279 

D 

0 

8 

18 

0.40 

0.39 

0.86 

-0.34 

3 

22 

22293 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

3 

22 

22293 

A 

1 

28 

64 

1.96 

0.24 

0.71 

0.71 

3 

22 

22293 

B 

0 

2 

5 

-0.60 

0.33 

0.28 

-0.22 

3 

22 

22293 

C 

0 

4 

9 

-0.35 

0.47 

0.47 

-0.28 

3 

22 

22293 

D 

0 

10 

23 

-0.48 

0.35 

0.50 

-0.52 

3 

23 

22096 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

3 

23 

22096 

A 

1 

34 

74 

2.20 

0.23 

0.95 

0.51 

3 

23 

22096 

B 

0 

3 

7 

0.34 

0.65 

0.58 

-0.27 

3 

23 

22096 

C 

0 

6 

13 

0.96 

0.33 

0.89 

-0.23 

3 

23 

22096 

D 

0 

3 

7 

0.02 

0.33 

0.30 

-0.33 

3 

24 

20A21 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

3 

24 

20A21 

A 

1 

46 

66 

1.87 

0.15 

0.87 

0.54 

3 

24 

20A21 

B 

0 

6 

9 

-0.03 

0.34 

0.39 

-0.40 

3 

24 

20A21 

C 

0 

18 

26 

0.80 

0.18 

0.81 

-0.33 

3 

24 

20A21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

3 

25 

22354 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

3 

25 

22354 

A 

1 

22 

49 

2.59 

0.28 

0.61 

0.68 

3 

25 

22354 

B 

0 

11 

24 

0.79 

0.37 

1.12 

-0.23 

3 

25 

22354 

C 

0 

4 

9 

-0.64 

0.27 

0.16 

-0.40 

3 

25 

22354 

D 

0 

8 

18 

0.30 

0.23 

0.45 

-0.33 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

1 

2G342 

* 

-1 

3925 

98 

1.50 

0.02 

0.00 

-0.07 

4 

1 

2G342 

A 

1 

64 

96 

2.33 

0.16 

0.96 

0.32 

4 

1 

2G342 

B 

0 

2 

3 

0.50 

0.27 

0.39 

-0.23 

4 

1 

2G342 

C 

0 

1 

1 

-0.16 

0.00 

0.19 

-0.22 

4 

1 

2G342 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

2 

2G132 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.01 

4 

2 

2G132 

A 

1 

66 

89 

1.51 

0.14 

1.03 

0.27 

4 

2 

2G132 

B 

0 

2 

3 

0.02 

0.27 

0.41 

-0.20 

4 

2 

2G132 

C 

0 

6 

8 

0.68 

0.34 

0.99 

-0.19 

4 

2 

2G132 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

3 

2G214 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

4 

3 

2G214 

A 

1 

51 

74 

1.73 

0.15 

1.09 

0.26 

4 

3 

2G214 

B 

0 

17 

25 

1.12 

0.22 

1.33 

-0.24 

4 

3 

2G214 

C 

0 

1 

1 

0.96 

0.00 

0.70 

-0.07 

4 

3 

2G214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

4 

23190 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

4 

4 

23190 

A 

1 

38 

84 

1.63 

0.23 

0.94 

0.32 

4 

4 

23190 

B 

0 

2 

4 

1.65 

0.88 

3.44 

0.03 

4 

4 

23190 

C 

0 

3 

7 

-0.48 

0.63 

0.41 

-0.33 

4 

4 

23190 

D 

0 

2 

4 

-0.02 

1.77 

1.38 

-0.20 

4 

5 

23290 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

4 

5 

23290 

A 

1 

36 

80 

1.81 

0.22 

0.73 

0.56 

4 

5 

23290 

B 

0 

4 

9 

0.34 

0.50 

0.97 

-0.16 

4 

5 

23290 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

5 

23290 

D 

0 

5 

11 

-1.63 

1.17 

0.47 

-0.57 

4 

6 

23348 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

4 

6 

23348 

A 

1 

36 

80 

1.94 

0.25 

0.92 

0.52 

4 

6 

23348 

B 

0 

6 

13 

-0.15 

0.62 

0.60 

-0.40 

4 

6 

23348 

C 

0 

3 

7 

-0.30 

0.38 

0.35 

-0.29 

4 

6 

23348 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

7 

23353 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

4 

7 

23353 

A 

1 

34 

74 

1.94 

0.27 

0.76 

0.52 

4 

7 

23353 

B 

0 

4 

9 

-0.03 

0.38 

0.58 

-0.26 

4 

7 

23353 

C 

0 

5 

11 

-0.03 

0.93 

2.05 

-0.29 

4 

7 

23353 

D 

0 

3 

7 

-0.40 

0.45 

0.38 

-0.28 

4 

8 

23387 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

4 

8 

23387 

A 

1 

32 

71 

1.77 

0.22 

0.93 

0.45 

4 

8 

23387 

B 

0 

7 

16 

0.95 

0.38 

1.45 

-0.11 

4 

8 

23387 

C 

0 

6 

13 

-0.44 

0.74 

1.13 

-0.48 

4 

8 

23387 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

9 

2MD49 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

4 

9 

2MD49 

A 

1 

48 

70 

2.53 

0.13 

0.71 

0.70 

4 

9 

2MD49 

B 

0 

8 

12 

0.56 

0.25 

0.36 

-0.46 

4 

9 

2MD49 

C 

0 

13 

19 

0.94 

0.11 

0.46 

-0.45 

4 

9 

2MD49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

10 

2MD1012 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

4 

10 

2MD1012 

A 

1 

36 

52 

2.24 

0.15 

0.72 

0.67 

4 

10 

2MD1012 

B 

0 

32 

46 

0.86 

0.12 

0.65 

-0.63 

4 

10 

2MD1012 

C 

0 

1 

1 

0.05 

0.00 

0.23 

-0.18 

4 

10 

2MD1012 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

11 

21507 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

4 

11 

21507 

A 

1 

39 

89 

1.58 

0.23 

1.02 

0.32 

4 

11 

21507 

B 

0 

1 

2 

1.54 

0.00 

2.29 

0.01 

4 

11 

21507 

C 

0 

1 

2 

1.18 

0.00 

1.59 

-0.03 

4 

11 

21507 

D 

0 

3 

7 

-0.71 

0.38 

0.27 

-0.39 

4 

12 

21674 

* 

-1 

3945 

99 

1.51 

0.02 

0.00 

-0.02 

4 

12 

21674 

A 

1 

42 

89 

1.90 

0.21 

1.14 

0.31 

4 

12 

21674 

B 

0 

2 

4 

0.66 

0.09 

0.65 

-0.17 

4 

12 

21674 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

12 

21674 

D 

0 

3 

6 

0.44 

0.46 

0.64 

-0.25 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

13 

2NBT916 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

4 

13 

2NBT916 

A 

1 

59 

88 

2.12 

0.18 

0.91 

0.39 

4 

13 

2NBT916 

B 

0 

4 

6 

1.08 

0.72 

1.67 

-0.14 

4 

13 

2NBT916 

C 

0 

4 

6 

-0.33 

0.12 

0.22 

-0.39 

4 

13 

2NBT916 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

14 

21502 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

4 

14 

21502 

A 

1 

37 

82 

1.87 

0.21 

0.64 

0.61 

4 

14 

21502 

B 

0 

5 

11 

-0.44 

0.60 

0.64 

-0.43 

4 

14 

21502 

C 

0 

2 

4 

-0.79 

0.23 

0.22 

-0.32 

4 

14 

21502 

D 

0 

1 

2 

-0.74 

0.00 

0.22 

-0.21 

4 

15 

21587 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

4 

15 

21587 

A 

1 

30 

68 

1.70 

0.27 

0.98 

0.50 

4 

15 

21587 

B 

0 

6 

14 

0.49 

0.37 

1.04 

-0.16 

4 

15 

21587 

C 

0 

5 

11 

0.26 

0.56 

0.97 

-0.19 

4 

15 

21587 

D 

0 

3 

7 

-1.65 

0.23 

0.10 

-0.47 

4 

16 

2NBT911 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

4 

16 

2NBT911 

A 

1 

71 

73 

2.15 

0.12 

1.11 

0.34 

4 

16 

2NBT911 

B 

0 

12 

12 

1.62 

0.30 

1.56 

-0.10 

4 

16 

2NBT911 

C 

0 

14 

14 

1.00 

0.31 

0.96 

-0.33 

4 

16 

2NBT911 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

17 

21825 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

4 

17 

21825 

A 

1 

16 

36 

1.79 

0.30 

1.00 

0.47 

4 

17 

21825 

B 

0 

22 

50 

0.61 

0.21 

0.89 

-0.35 

4 

17 

21825 

C 

0 

3 

7 

0.54 

0.93 

1.03 

-0.11 

4 

17 

21825 

D 

0 

3 

7 

0.60 

0.78 

1.09 

-0.10 

4 

18 

22345 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

4 

18 

22345 

A 

1 

36 

80 

1.53 

0.19 

0.89 

0.50 

4 

18 

22345 

B 

0 

4 

9 

0.08 

0.61 

0.89 

-0.28 

4 

18 

22345 

C 

0 

3 

7 

-0.37 

0.79 

0.59 

-0.33 

4 

18 

22345 

D 

0 

2 

4 

0.14 

0.22 

0.54 

-0.18 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

19 

22291 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

4 

19 

22291 

A 

1 

35 

80 

1.89 

0.26 

1.10 

0.48 

4 

19 

22291 

B 

0 

4 

9 

0.10 

0.28 

0.53 

-0.28 

4 

19 

22291 

C 

0 

3 

7 

0.28 

0.92 

1.15 

-0.21 

4 

19 

22291 

D 

0 

2 

5 

-0.59 

0.07 

0.24 

-0.29 

4 

20 

22280 

* 

-1 

3790 

95 

1.52 

0.02 

0.00 

0.02 

4 

20 

22280 

A 

1 

154 

76 

1.68 

0.10 

0.96 

0.38 

4 

20 

22280 

B 

0 

20 

10 

0.44 

0.27 

1.10 

-0.24 

4 

20 

22280 

C 

0 

23 

11 

0.53 

0.20 

1.03 

-0.24 

4 

20 

22280 

D 

0 

5 

2 

0.53 

0.35 

0.75 

-0.11 

4 

21 

22385 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

4 

21 

22385 

A 

1 

30 

67 

1.58 

0.28 

0.91 

0.49 

4 

21 

22385 

B 

0 

6 

13 

-0.41 

0.65 

0.71 

-0.35 

4 

21 

22385 

C 

0 

6 

13 

0.15 

0.45 

0.91 

-0.21 

4 

21 

22385 

D 

0 

3 

7 

0.02 

0.64 

0.75 

-0.17 

4 

22 

22249 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

4 

22 

22249 

A 

1 

31 

69 

1.82 

0.24 

0.75 

0.53 

4 

22 

22249 

B 

0 

3 

7 

-0.51 

0.58 

0.36 

-0.33 

4 

22 

22249 

C 

0 

5 

11 

0.75 

0.29 

1.03 

-0.13 

4 

22 

22249 

D 

0 

6 

13 

-0.06 

0.52 

0.78 

-0.36 

4 

23 

22194 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

4 

23 

22194 

A 

1 

31 

70 

1.93 

0.26 

1.16 

0.41 

4 

23 

22194 

B 

0 

6 

14 

0.79 

0.58 

1.53 

-0.20 

4 

23 

22194 

C 

0 

4 

9 

0.41 

0.40 

0.62 

-0.24 

4 

23 

22194 

D 

0 

3 

7 

0.58 

0.81 

1.18 

-0.18 

4 

24 

22349 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

4 

24 

22349 

A 

1 

32 

71 

2.14 

0.17 

0.79 

0.55 

4 

24 

22349 

B 

0 

8 

18 

0.84 

0.39 

0.77 

-0.36 

4 

24 

22349 

C 

0 

1 

2 

1.90 

0.00 

1.48 

0.02 

4 

24 

22349 

D 

0 

4 

9 

0.27 

0.32 

0.34 

-0.40 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

4 

25 

20A15 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

4 

25 

20A15 

A 

1 

43 

65 

2.71 

0.20 

1.23 

0.45 

4 

25 

20A15 

B 

0 

8 

12 

1.04 

0.43 

0.86 

-0.34 

4 

25 

20A15 

C 

0 

15 

23 

1.68 

0.21 

1.01 

-0.24 

4 

25 

20A15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

1 

2G120 

* 

-1 

3825 

96 

1.50 

0.02 

0.00 

-0.04 

5 

1 

2G120 

A 

1 

157 

94 

1.83 

0.09 

1.02 

0.18 

5 

1 

2G120 

B 

0 

7 

4 

1.01 

0.30 

1.02 

-0.15 

5 

1 

2G120 

C 

0 

3 

2 

0.97 

0.91 

1.65 

-0.10 

5 

1 

2G120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

2 

2G336 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

5 

2 

2G336 

A 

1 

63 

91 

1.69 

0.13 

0.93 

0.37 

5 

2 

2G336 

B 

0 

2 

3 

0.63 

0.33 

0.61 

-0.15 

5 

2 

2G336 

C 

0 

4 

6 

0.14 

0.06 

0.36 

-0.34 

5 

2 

2G336 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

3 

2G121 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.02 

5 

3 

2G121 

A 

1 

44 

59 

1.93 

0.23 

1.11 

0.47 

5 

3 

2G121 

B 

0 

16 

22 

0.95 

0.22 

1.24 

-0.13 

5 

3 

2G121 

C 

0 

14 

19 

-0.15 

0.29 

0.45 

-0.46 

5 

3 

2G121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

4 

23255 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

5 

4 

23255 

A 

1 

37 

84 

1.40 

0.20 

0.82 

0.50 

5 

4 

23255 

B 

0 

3 

7 

-0.50 

0.64 

0.48 

-0.34 

5 

4 

23255 

C 

0 

2 

5 

0.17 

0.84 

0.87 

-0.16 

5 

4 

23255 

D 

0 

2 

5 

-0.69 

0.30 

0.28 

-0.30 

5 

5 

2MD64 

* 

-1 

3839 

96 

1.51 

0.02 

0.00 

-0.01 

5 

5 

2MD64 

A 

1 

131 

86 

1.66 

0.10 

1.08 

0.19 

5 

5 

2MD64 

B 

0 

20 

13 

1.16 

0.17 

1.24 

-0.15 

5 

5 

2MD64 

C 

0 

2 

1 

0.23 

1.02 

0.59 

-0.14 

5 

5 

2MD64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

6 

23282 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

5 

6 

23282 

A 

1 

34 

77 

1.73 

0.21 

0.72 

0.61 

5 

6 

23282 

B 

0 

5 

11 

0.21 

0.48 

0.89 

-0.25 

5 

6 

23282 

C 

0 

2 

5 

-0.31 

0.48 

0.39 

-0.23 

5 

6 

23282 

D 

0 

3 

7 

-1.59 

0.20 

0.10 

-0.51 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

7 

2MD211 

* 

-1 

3825 

96 

1.50 

0.02 

0.00 

-0.04 

5 

7 

2MD211 

A 

1 

139 

83 

1.94 

0.09 

1.02 

0.32 

5 

7 

2MD211 

B 

0 

23 

14 

1.08 

0.19 

1.08 

-0.25 

5 

7 

2MD211 

C 

0 

5 

3 

0.62 

0.48 

0.73 

-0.18 

5 

7 

2MD211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

8 

23339 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

5 

8 

23339 

A 

1 

31 

69 

1.88 

0.27 

0.80 

0.54 

5 

8 

23339 

B 

0 

10 

22 

0.24 

0.29 

0.70 

-0.37 

5 

8 

23339 

C 

0 

2 

4 

-0.33 

1.23 

0.56 

-0.23 

5 

8 

23339 

D 

0 

2 

4 

-0.48 

0.53 

0.30 

-0.25 

5 

9 

2MD72 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

5 

9 

2MD72 

A 

1 

53 

62 

1.85 

0.16 

1.20 

0.28 

5 

9 

2MD72 

B 

0 

18 

21 

1.13 

0.20 

1.06 

-0.22 

5 

9 

2MD72 

C 

0 

14 

16 

1.28 

0.29 

1.61 

-0.13 

5 

9 

2MD72 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

10 

23301 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.06 

5 

10 

23301 

A 

1 

29 

64 

2.73 

0.25 

1.22 

0.41 

5 

10 

23301 

B 

0 

5 

11 

1.13 

0.23 

0.47 

-0.30 

5 

10 

23301 

C 

0 

9 

20 

2.07 

0.43 

2.11 

-0.08 

5 

10 

23301 

D 

0 

2 

4 

0.07 

0.35 

0.16 

-0.34 

5 

11 

21696 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

5 

11 

21696 

A 

1 

40 

87 

1.31 

0.22 

1.19 

0.22 

5 

11 

21696 

B 

0 

4 

9 

0.78 

0.59 

2.02 

-0.09 

5 

11 

21696 

C 

0 

2 

4 

-0.29 

0.06 

0.42 

-0.23 

5 

11 

21696 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

12 

21710 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

5 

12 

21710 

A 

1 

38 

84 

1.62 

0.25 

1.02 

0.42 

5 

12 

21710 

B 

0 

3 

7 

0.15 

0.24 

0.63 

-0.21 

5 

12 

21710 

C 

0 

3 

7 

-0.05 

0.06 

0.49 

-0.24 

5 

12 

21710 

D 

0 

1 

2 

-1.57 

0.00 

0.11 

-0.28 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

13 

2NBT99 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.02 

5 

13 

2NBT99 

A 

1 

64 

86 

1.40 

0.10 

1.00 

0.21 

5 

13 

2NBT99 

B 

0 

8 

11 

0.62 

0.32 

0.87 

-0.29 

5 

13 

2NBT99 

C 

0 

2 

3 

1.92 

0.21 

2.34 

0.12 

5 

13 

2NBT99 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

14 

21627 

* 

-1 

3938 

99 

1.51 

0.02 

0.00 

-0.01 

5 

14 

21627 

A 

1 

45 

83 

2.00 

0.19 

0.80 

0.56 

5 

14 

21627 

B 

0 

1 

2 

-0.92 

0.00 

0.15 

-0.23 

5 

14 

21627 

C 

0 

6 

11 

0.21 

0.38 

0.64 

-0.33 

5 

14 

21627 

D 

0 

2 

4 

-1.44 

0.80 

0.12 

-0.40 

5 

15 

21571 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

5 

15 

21571 

A 

1 

32 

73 

2.04 

0.27 

0.85 

0.52 

5 

15 

21571 

B 

0 

4 

9 

-0.22 

0.35 

0.39 

-0.30 

5 

15 

21571 

C 

0 

5 

11 

0.57 

0.65 

1.40 

-0.18 

5 

15 

21571 

D 

0 

3 

7 

-0.84 

1.68 

0.83 

-0.35 

5 

16 

21517 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

5 

16 

21517 

A 

1 

27 

60 

1.76 

0.22 

0.86 

0.45 

5 

16 

21517 

B 

0 

3 

7 

0.68 

1.20 

1.51 

-0.11 

5 

16 

21517 

C 

0 

11 

24 

0.47 

0.40 

1.23 

-0.32 

5 

16 

21517 

D 

0 

4 

9 

0.42 

0.68 

1.03 

-0.19 

5 

17 

21872 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

5 

17 

21872 

A 

1 

18 

40 

2.48 

0.26 

0.53 

0.68 

5 

17 

21872 

B 

0 

17 

38 

0.56 

0.21 

0.70 

-0.26 

5 

17 

21872 

C 

0 

6 

13 

0.26 

0.55 

0.62 

-0.20 

5 

17 

21872 

D 

0 

4 

9 

-1.39 

0.91 

0.17 

-0.48 

5 

18 

22251 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

5 

18 

22251 

A 

1 

36 

80 

1.67 

0.23 

0.90 

0.50 

5 

18 

22251 

B 

0 

3 

7 

-0.94 

0.63 

0.25 

-0.41 

5 

18 

22251 

C 

0 

4 

9 

0.22 

0.47 

0.78 

-0.23 

5 

18 

22251 

D 

0 

2 

4 

0.21 

0.36 

0.61 

-0.16 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

19 

20A429 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.01 

5 

19 

20A429 

A 

1 

66 

83 

1.65 

0.12 

0.94 

0.41 

5 

19 

20A429 

B 

0 

12 

15 

0.51 

0.20 

0.62 

-0.38 

5 

19 

20A429 

C 

0 

2 

3 

0.61 

0.58 

0.67 

-0.13 

5 

19 

20A429 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

20 

22071 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

5 

20 

22071 

A 

1 

33 

72 

1.49 

0.22 

0.88 

0.46 

5 

20 

22071 

B 

0 

3 

7 

0.67 

0.69 

1.49 

-0.08 

5 

20 

22071 

C 

0 

7 

15 

0.43 

0.21 

0.82 

-0.21 

5 

20 

22071 

D 

0 

3 

7 

-1.28 

0.77 

0.22 

-0.46 

5 

21 

22179 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

5 

21 

22179 

A 

1 

35 

78 

2.21 

0.23 

0.76 

0.52 

5 

21 

22179 

B 

0 

2 

4 

0.11 

1.06 

0.53 

-0.24 

5 

21 

22179 

C 

0 

3 

7 

-0.42 

0.35 

0.22 

-0.39 

5 

21 

22179 

D 

0 

5 

11 

0.86 

0.55 

1.15 

-0.22 

5 

22 

20A216 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

5 

22 

20A216 

A 

1 

52 

75 

1.80 

0.15 

0.99 

0.38 

5 

22 

20A216 

B 

0 

8 

12 

0.95 

0.20 

0.80 

-0.21 

5 

22 

20A216 

C 

0 

9 

13 

0.79 

0.30 

0.95 

-0.29 

5 

22 

20A216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

23 

22054 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

5 

23 

22054 

A 

1 

31 

67 

1.91 

0.24 

1.08 

0.56 

5 

23 

22054 

B 

0 

7 

15 

0.27 

0.29 

0.62 

-0.28 

5 

23 

22054 

C 

0 

1 

2 

-0.99 

0.00 

0.14 

-0.22 

5 

23 

22054 

D 

0 

7 

15 

-0.03 

0.66 

0.79 

-0.36 

5 

24 

22104 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

5 

24 

22104 

A 

1 

29 

64 

1.90 

0.28 

1.53 

0.41 

5 

24 

22104 

B 

0 

7 

16 

0.80 

0.40 

1.03 

-0.20 

5 

24 

22104 

C 

0 

8 

18 

0.65 

0.23 

0.72 

-0.27 

5 

24 

22104 

D 

0 

1 

2 

-0.01 

0.00 

0.31 

-0.16 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

5 

25 

22313 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.05 

5 

25 

22313 

A 

1 

17 

39 

1.85 

0.26 

0.69 

0.64 

5 

25 

22313 

B 

0 

13 

30 

0.32 

0.21 

0.65 

-0.29 

5 

25 

22313 

C 

0 

7 

16 

0.68 

0.36 

1.04 

-0.07 

5 

25 

22313 

D 

0 

7 

16 

-0.31 

0.30 

0.35 

-0.43 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

1 

2G312 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

6 

1 

2G312 

A 

1 

64 

94 

2.20 

0.16 

0.80 

0.44 

6 

1 

2G312 

B 

0 

3 

4 

-0.29 

0.48 

0.26 

-0.35 

6 

1 

2G312 

C 

0 

1 

1 

-0.96 

0.00 

0.11 

-0.26 

6 

1 

2G312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

2 

2G239 

* 

-1 

3857 

97 

1.50 

0.02 

0.00 

-0.07 

6 

2 

2G239 

A 

1 

125 

93 

2.23 

0.12 

0.90 

0.40 

6 

2 

2G239 

B 

0 

1 

1 

-0.33 

0.00 

0.19 

-0.15 

6 

2 

2G239 

C 

0 

9 

7 

0.11 

0.20 

0.36 

-0.37 

6 

2 

2G239 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

3 

2G137 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.02 

6 

3 

2G137 

A 

1 

46 

62 

1.79 

0.23 

1.18 

0.38 

6 

3 

2G137 

B 

0 

16 

22 

0.60 

0.35 

1.32 

-0.25 

6 

3 

2G137 

C 

0 

12 

16 

0.50 

0.33 

1.47 

-0.23 

6 

3 

2G137 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

4 

23007 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

6 

4 

23007 

A 

1 

38 

86 

1.60 

0.20 

0.86 

0.45 

6 

4 

23007 

B 

0 

1 

2 

0.32 

0.00 

0.61 

-0.12 

6 

4 

23007 

C 

0 

5 

11 

-0.26 

0.54 

0.54 

-0.44 

6 

4 

23007 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

5 

23173 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

6 

5 

23173 

A 

1 

35 

78 

1.34 

0.22 

1.15 

0.35 

6 

5 

23173 

B 

0 

2 

4 

-0.90 

0.83 

0.29 

-0.32 

6 

5 

23173 

C 

0 

6 

13 

0.70 

0.53 

1.71 

-0.11 

6 

5 

23173 

D 

0 

2 

4 

-0.15 

0.36 

0.47 

-0.20 

6 

6 

2MD99 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

6 

6 

2MD99 

A 

1 

57 

85 

2.21 

0.18 

0.85 

0.49 

6 

6 

2MD99 

B 

0 

8 

12 

0.27 

0.36 

0.62 

-0.41 

6 

6 

2MD99 

C 

0 

2 

3 

0.00 

0.07 

0.28 

-0.23 

6 

6 

2MD99 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Second  Grade  Math  Measure  Development 


112 

Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

7 

23109 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

6 

7 

23109 

A 

1 

34 

76 

1.66 

0.24 

1.22 

0.35 

6 

7 

23109 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

7 

23109 

C 

0 

10 

22 

0.44 

0.43 

1.08 

-0.34 

6 

7 

23109 

D 

0 

1 

2 

1.03 

0.00 

1.09 

-0.04 

6 

8 

2MD812 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

6 

8 

2MD812 

A 

1 

64 

76 

1.78 

0.15 

1.17 

0.32 

6 

8 

2MD812 

B 

0 

7 

8 

0.77 

0.25 

0.72 

-0.21 

6 

8 

2MD812 

C 

0 

13 

15 

1.01 

0.20 

0.98 

-0.21 

6 

8 

2MD812 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

9 

23102 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

6 

9 

23102 

A 

1 

28 

61 

2.15 

0.27 

1.01 

0.45 

6 

9 

23102 

B 

0 

1 

2 

0.35 

0.00 

0.38 

-0.13 

6 

9 

23102 

C 

0 

17 

37 

0.80 

0.32 

1.27 

-0.41 

6 

9 

23102 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

10 

2MD87 

* 

-1 

3831 

96 

1.52 

0.02 

0.00 

0.01 

6 

10 

2MD87 

A 

1 

81 

50 

1.94 

0.13 

1.07 

0.44 

6 

10 

2MD87 

B 

0 

71 

44 

1.01 

0.10 

0.99 

-0.36 

6 

10 

2MD87 

C 

0 

9 

6 

0.58 

0.26 

0.56 

-0.19 

6 

10 

2MD87 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

11 

21679 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

6 

11 

21679 

A 

1 

40 

89 

1.67 

0.23 

1.00 

0.31 

6 

11 

21679 

B 

0 

3 

7 

1.14 

0.30 

1.66 

-0.07 

6 

11 

21679 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

11 

21679 

D 

0 

2 

4 

-1.26 

0.27 

0.14 

-0.40 

6 

12 

21522 

* 

-1 

3812 

95 

1.49 

0.02 

0.00 

-0.07 

6 

12 

21522 

A 

1 

163 

91 

2.13 

0.11 

0.97 

0.34 

6 

12 

21522 

B 

0 

9 

5 

0.67 

0.25 

0.71 

-0.21 

6 

12 

21522 

C 

0 

7 

4 

0.49 

0.51 

1.41 

-0.21 

6 

12 

21522 

D 

0 

1 

1 

-1.42 

0.00 

0.07 

-0.18 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

13 

21707 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

6 

13 

21707 

A 

1 

38 

84 

1.67 

0.18 

0.79 

0.49 

6 

13 

21707 

B 

0 

4 

9 

-0.92 

0.28 

0.18 

-0.56 

6 

13 

21707 

C 

0 

3 

7 

1.03 

0.48 

1.46 

-0.08 

6 

13 

21707 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

14 

21776 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

6 

14 

21776 

A 

1 

38 

83 

1.88 

0.23 

0.77 

0.53 

6 

14 

21776 

B 

0 

4 

9 

-0.30 

0.61 

0.53 

-0.36 

6 

14 

21776 

C 

0 

4 

9 

-0.23 

0.15 

0.35 

-0.35 

6 

14 

21776 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

15 

2NBT920 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

6 

15 

2NBT920 

A 

1 

57 

75 

1.72 

0.14 

0.84 

0.44 

6 

15 

2NBT920 

B 

0 

5 

7 

0.44 

0.29 

0.60 

-0.23 

6 

15 

2NBT920 

C 

0 

14 

18 

0.58 

0.32 

1.45 

-0.35 

6 

15 

2NBT920 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

16 

2NBT620 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

6 

16 

2NBT620 

A 

1 

42 

61 

1.94 

0.22 

0.91 

0.47 

6 

16 

2NBT620 

B 

0 

14 

20 

0.49 

0.31 

1.38 

-0.31 

6 

16 

2NBT620 

C 

0 

13 

19 

0.58 

0.27 

0.95 

-0.27 

6 

16 

2NBT620 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

17 

21871 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

6 

17 

21871 

A 

1 

19 

43 

2.31 

0.48 

1.74 

0.43 

6 

17 

21871 

B 

0 

21 

48 

0.95 

0.21 

1.20 

-0.29 

6 

17 

21871 

C 

0 

1 

2 

0.07 

0.00 

0.32 

-0.12 

6 

17 

21871 

D 

0 

3 

7 

0.18 

1.11 

0.74 

-0.20 

6 

18 

20A326 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

6 

18 

20A326 

A 

1 

86 

89 

2.09 

0.11 

0.93 

0.42 

6 

18 

20A326 

B 

0 

2 

2 

0.08 

0.20 

0.26 

-0.24 

6 

18 

20A326 

C 

0 

9 

9 

0.72 

0.37 

0.97 

-0.34 

6 

18 

20A326 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

19 

22010 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

6 

19 

22010 

A 

1 

36 

80 

1.85 

0.26 

1.15 

0.36 

6 

19 

22010 

B 

0 

5 

11 

0.00 

0.62 

0.77 

-0.34 

6 

19 

22010 

C 

0 

2 

4 

1.63 

1.02 

3.34 

0.01 

6 

19 

22010 

D 

0 

2 

4 

0.14 

0.31 

0.50 

-0.19 

6 

20 

20A29 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

6 

20 

20A29 

A 

1 

67 

80 

1.77 

0.14 

1.05 

0.34 

6 

20 

20A29 

B 

0 

4 

5 

0.34 

0.06 

0.41 

-0.24 

6 

20 

20A29 

C 

0 

13 

15 

0.96 

0.25 

1.05 

-0.23 

6 

20 

20A29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

21 

22142 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

6 

21 

22142 

A 

1 

32 

73 

2.06 

0.26 

0.99 

0.52 

6 

21 

22142 

B 

0 

4 

9 

0.61 

0.47 

0.89 

-0.14 

6 

21 

22142 

C 

0 

5 

11 

0.87 

0.68 

2.38 

-0.11 

6 

21 

22142 

D 

0 

3 

7 

-2.75 

0.89 

0.06 

-0.61 

6 

22 

22154 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

6 

22 

22154 

A 

1 

33 

72 

2.24 

0.28 

0.91 

0.53 

6 

22 

22154 

B 

0 

3 

7 

1.74 

0.71 

3.62 

0.01 

6 

22 

22154 

C 

0 

3 

7 

-0.06 

0.30 

0.38 

-0.25 

6 

22 

22154 

D 

0 

7 

15 

-0.48 

0.44 

0.37 

-0.50 

6 

23 

22383 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

6 

23 

22383 

A 

1 

32 

71 

1.88 

0.19 

0.86 

0.57 

6 

23 

22383 

B 

0 

5 

11 

0.82 

0.37 

0.87 

-0.19 

6 

23 

22383 

C 

0 

5 

11 

0.05 

0.36 

0.42 

-0.42 

6 

23 

22383 

D 

0 

3 

7 

0.29 

0.28 

0.44 

-0.26 

6 

24 

22192 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

6 

24 

22192 

A 

1 

28 

62 

1.84 

0.25 

1.14 

0.43 

6 

24 

22192 

B 

0 

6 

13 

0.60 

0.58 

2.16 

-0.21 

6 

24 

22192 

C 

0 

4 

9 

1.22 

0.81 

2.46 

-0.03 

6 

24 

22192 

D 

0 

7 

16 

0.14 

0.39 

0.59 

-0.36 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

6 

25 

22247 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

6 

25 

22247 

A 

1 

26 

58 

2.35 

0.22 

1.18 

0.47 

6 

25 

22247 

B 

0 

2 

4 

0.65 

1.00 

0.52 

-0.15 

6 

25 

22247 

C 

0 

11 

24 

1.17 

0.43 

1.47 

-0.20 

6 

25 

22247 

D 

0 

6 

13 

0.36 

1.01 

0.83 

-0.34 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

1 

2G220 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

7 

1 

2G220 

A 

1 

64 

94 

2.19 

0.17 

0.82 

0.42 

7 

1 

2G220 

B 

0 

2 

3 

-0.48 

0.69 

0.22 

-0.31 

7 

1 

2G220 

C 

0 

2 

3 

-0.18 

0.77 

0.31 

-0.27 

7 

1 

2G220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

2 

2G240 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

7 

2 

2G240 

A 

1 

70 

90 

1.47 

0.14 

1.04 

0.16 

7 

2 

2G240 

B 

0 

6 

8 

1.40 

0.25 

1.87 

0.00 

7 

2 

2G240 

C 

0 

2 

3 

-0.77 

0.27 

0.19 

-0.30 

7 

2 

2G240 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

3 

2G333 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

7 

3 

2G333 

A 

1 

62 

78 

2.52 

0.16 

1.09 

0.33 

7 

3 

2G333 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

3 

2G333 

C 

0 

18 

23 

1.49 

0.28 

1.21 

-0.33 

7 

3 

2G333 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

4 

23040 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

7 

4 

23040 

A 

1 

40 

89 

1.95 

0.24 

1.13 

0.28 

7 

4 

23040 

B 

0 

4 

9 

0.65 

0.78 

1.51 

-0.23 

7 

4 

23040 

C 

0 

1 

2 

0.42 

0.00 

0.54 

-0.14 

7 

4 

23040 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

5 

2MD312 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

7 

5 

2MD312 

A 

1 

79 

87 

1.95 

0.13 

0.96 

0.33 

7 

5 

2MD312 

B 

0 

6 

7 

1.18 

0.47 

1.36 

-0.14 

7 

5 

2MD312 

C 

0 

6 

7 

0.38 

0.36 

0.55 

-0.32 

7 

5 

2MD312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

6 

23258 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

7 

6 

23258 

A 

1 

38 

83 

1.72 

0.19 

0.97 

0.38 

7 

6 

23258 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

6 

23258 

C 

0 

3 

7 

0.63 

0.12 

0.64 

-0.19 

7 

6 

23258 

D 

0 

5 

11 

0.45 

0.65 

1.15 

-0.31 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

7 

23383 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

7 

7 

23383 

A 

1 

35 

78 

2.08 

0.25 

0.76 

0.57 

7 

7 

23383 

B 

0 

5 

11 

-0.08 

0.30 

0.44 

-0.37 

7 

7 

23383 

C 

0 

3 

7 

0.23 

0.45 

0.59 

-0.23 

7 

7 

23383 

D 

0 

2 

4 

-0.61 

0.89 

0.30 

-0.30 

7 

8 

23394 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

7 

8 

23394 

A 

1 

32 

71 

1.97 

0.28 

0.85 

0.49 

7 

8 

23394 

B 

0 

3 

7 

-0.37 

0.39 

0.32 

-0.31 

7 

8 

23394 

C 

0 

7 

16 

0.26 

0.22 

0.63 

-0.33 

7 

8 

23394 

D 

0 

3 

7 

0.92 

0.69 

1.68 

-0.10 

7 

9 

23329 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

7 

9 

23329 

A 

1 

26 

58 

1.90 

0.29 

1.37 

0.41 

7 

9 

23329 

B 

0 

7 

16 

0.51 

0.25 

0.61 

-0.28 

7 

9 

23329 

C 

0 

8 

18 

1.19 

0.26 

1.18 

-0.07 

7 

9 

23329 

D 

0 

4 

9 

0.20 

0.82 

0.71 

-0.27 

7 

10 

23175 

* 

-1 

3773 

95 

1.52 

0.02 

0.00 

0.00 

7 

10 

23175 

A 

1 

109 

50 

1.97 

0.11 

1.06 

0.38 

7 

10 

23175 

B 

0 

28 

13 

0.59 

0.19 

0.67 

-0.29 

7 

10 

23175 

C 

0 

81 

37 

1.22 

0.11 

1.25 

-0.19 

7 

10 

23175 

D 

0 

1 

0 

1.13 

0.00 

0.72 

-0.02 

7 

11 

2NBT613 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

7 

11 

2NBT613 

A 

1 

62 

94 

2.19 

0.18 

1.09 

0.21 

7 

11 

2NBT613 

B 

0 

2 

3 

0.89 

0.53 

0.70 

-0.16 

7 

11 

2NBT613 

C 

0 

2 

3 

1.01 

0.79 

0.91 

-0.14 

7 

11 

2NBT613 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

12 

21709 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

7 

12 

21709 

A 

1 

40 

89 

1.78 

0.21 

0.98 

0.29 

7 

12 

21709 

B 

0 

2 

4 

1.74 

0.04 

2.10 

0.02 

7 

12 

21709 

C 

0 

2 

4 

-0.29 

1.02 

0.43 

-0.31 

7 

12 

21709 

D 

0 

1 

2 

-0.21 

0.00 

0.30 

-0.21 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

13 

21623 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

7 

13 

21623 

A 

1 

39 

87 

1.63 

0.19 

1.06 

0.25 

7 

13 

21623 

B 

0 

2 

4 

0.35 

0.88 

0.70 

-0.21 

7 

13 

21623 

C 

0 

4 

9 

0.99 

0.64 

1.58 

-0.14 

7 

13 

21623 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

14 

2NBT820 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

7 

14 

2NBT820 

A 

1 

58 

87 

2.17 

0.18 

0.96 

0.44 

7 

14 

2NBT820 

B 

0 

3 

4 

0.53 

0.54 

0.67 

-0.20 

7 

14 

2NBT820 

C 

0 

6 

9 

0.15 

0.25 

0.39 

-0.38 

7 

14 

2NBT820 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

15 

2NBT93 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

7 

15 

2NBT93 

A 

1 

68 

85 

2.57 

0.14 

0.83 

0.50 

7 

15 

2NBT93 

B 

0 

5 

6 

1.27 

0.37 

0.81 

-0.20 

7 

15 

2NBT93 

C 

0 

7 

9 

0.34 

0.35 

0.34 

-0.46 

7 

15 

2NBT93 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

16 

2NBT66 

* 

-1 

3917 

98 

1.52 

0.02 

0.00 

0.02 

7 

16 

2NBT66 

A 

1 

47 

63 

1.47 

0.12 

1.19 

0.23 

7 

16 

2NBT66 

B 

0 

12 

16 

1.18 

0.26 

1.42 

-0.07 

7 

16 

2NBT66 

C 

0 

16 

21 

0.98 

0.18 

1.02 

-0.21 

7 

16 

2NBT66 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

17 

2NBT720 

* 

-1 

3917 

98 

1.52 

0.02 

0.00 

0.02 

7 

17 

2NBT720 

A 

1 

31 

41 

1.68 

0.15 

0.97 

0.36 

7 

17 

2NBT720 

B 

0 

4 

5 

0.63 

0.36 

0.56 

-0.20 

7 

17 

2NBT720 

C 

0 

40 

53 

1.11 

0.12 

1.02 

-0.27 

7 

17 

2NBT720 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

18 

22138 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

7 

18 

22138 

A 

1 

39 

87 

2.04 

0.21 

0.95 

0.44 

7 

18 

22138 

B 

0 

2 

4 

0.38 

0.44 

0.48 

-0.23 

7 

18 

22138 

C 

0 

2 

4 

0.43 

0.55 

0.53 

-0.22 

7 

18 

22138 

D 

0 

2 

4 

0.09 

0.50 

0.37 

-0.27 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

19 

22168 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

7 

19 

22168 

A 

1 

37 

80 

1.75 

0.19 

0.79 

0.53 

7 

19 

22168 

B 

0 

2 

4 

-0.14 

0.11 

0.34 

-0.25 

7 

19 

22168 

C 

0 

2 

4 

1.01 

0.92 

1.54 

-0.07 

7 

19 

22168 

D 

0 

5 

11 

-0.30 

0.37 

0.37 

-0.46 

7 

20 

22077 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

7 

20 

22077 

A 

1 

36 

78 

2.06 

0.25 

0.94 

0.45 

7 

20 

22077 

B 

0 

3 

7 

0.42 

0.88 

1.08 

-0.22 

7 

20 

22077 

C 

0 

7 

15 

0.34 

0.35 

0.71 

-0.37 

7 

20 

22077 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

21 

22267 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

7 

21 

22267 

A 

1 

34 

76 

1.84 

0.21 

1.01 

0.41 

7 

21 

22267 

B 

0 

5 

11 

0.38 

0.45 

0.70 

-0.31 

7 

21 

22267 

C 

0 

5 

11 

0.93 

0.76 

2.30 

-0.16 

7 

21 

22267 

D 

0 

1 

2 

-0.09 

0.00 

0.30 

-0.18 

7 

22 

22393 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

7 

22 

22393 

A 

1 

30 

65 

1.90 

0.25 

0.81 

0.60 

7 

22 

22393 

B 

0 

6 

13 

0.38 

0.62 

1.58 

-0.15 

7 

22 

22393 

C 

0 

1 

2 

-0.08 

0.00 

0.40 

-0.10 

7 

22 

22393 

D 

0 

9 

20 

-0.96 

0.57 

0.39 

-0.56 

7 

23 

20A336 

* 

-1 

3917 

98 

1.52 

0.02 

0.00 

0.01 

7 

23 

20A336 

A 

1 

53 

71 

1.67 

0.17 

1.13 

0.31 

7 

23 

20A336 

B 

0 

13 

17 

0.96 

0.19 

0.96 

-0.19 

7 

23 

20A336 

C 

0 

9 

12 

0.77 

0.35 

1.24 

-0.21 

7 

23 

20A336 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

24 

22348 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

7 

24 

22348 

A 

1 

29 

64 

1.99 

0.27 

0.97 

0.45 

7 

24 

22348 

B 

0 

6 

13 

0.65 

0.49 

0.96 

-0.24 

7 

24 

22348 

C 

0 

5 

11 

0.40 

0.43 

0.70 

-0.27 

7 

24 

22348 

D 

0 

5 

11 

0.90 

0.35 

1.01 

-0.15 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

7 

25 

22205 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

7 

25 

22205 

A 

1 

25 

56 

2.61 

0.31 

1.00 

0.56 

7 

25 

22205 

B 

0 

1 

2 

-0.28 

0.00 

0.19 

-0.18 

7 

25 

22205 

C 

0 

13 

29 

0.69 

0.26 

0.73 

-0.40 

7 

25 

22205 

D 

0 

6 

13 

0.89 

0.81 

1.65 

-0.20 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

1 

2G236 

* 

-1 

3925 

98 

1.50 

0.02 

0.00 

-0.07 

8 

1 

2G236 

A 

1 

64 

96 

2.30 

0.17 

1.00 

0.20 

8 

1 

2G236 

B 

0 

3 

4 

1.03 

0.75 

0.99 

-0.20 

8 

1 

2G236 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

1 

2G236 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

2 

2G31 

* 

-1 

3906 

98 

1.51 

0.02 

0.00 

-0.01 

8 

2 

2G31 

A 

1 

79 

92 

1.70 

0.13 

1.01 

0.26 

8 

2 

2G31 

B 

0 

6 

7 

0.80 

0.17 

0.75 

-0.20 

8 

2 

2G31 

C 

0 

1 

1 

-0.29 

0.00 

0.23 

-0.18 

8 

2 

2G31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

3 

2G38 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

8 

3 

2G38 

A 

1 

60 

72 

1.57 

0.14 

1.15 

0.13 

8 

3 

2G38 

B 

0 

1 

1 

1.36 

0.00 

1.08 

-0.01 

8 

3 

2G38 

C 

0 

22 

27 

1.26 

0.22 

1.53 

-0.13 

8 

3 

2G38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

4 

23050 

* 

-1 

3759 

94 

1.52 

0.02 

0.00 

0.02 

8 

4 

23050 

A 

1 

205 

88 

1.50 

0.08 

1.04 

0.26 

8 

4 

23050 

B 

0 

7 

3 

0.63 

0.46 

1.32 

-0.12 

8 

4 

23050 

C 

0 

19 

8 

0.66 

0.21 

1.04 

-0.20 

8 

4 

23050 

D 

0 

2 

1 

-0.04 

0.85 

0.49 

-0.12 

8 

5 

23380 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

8 

5 

23380 

A 

1 

36 

80 

1.74 

0.24 

1.18 

0.48 

8 

5 

23380 

B 

0 

2 

4 

-0.11 

0.74 

0.53 

-0.21 

8 

5 

23380 

C 

0 

4 

9 

-0.39 

0.50 

0.43 

-0.37 

8 

5 

23380 

D 

0 

3 

7 

0.37 

0.22 

0.70 

-0.18 

8 

6 

23069 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

8 

6 

23069 

A 

1 

36 

82 

1.96 

0.27 

1.86 

0.36 

8 

6 

23069 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

6 

23069 

C 

0 

4 

9 

-0.61 

0.62 

0.38 

-0.44 

8 

6 

23069 

D 

0 

4 

9 

1.46 

0.29 

1.68 

-0.04 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

7 

23105 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

8 

7 

23105 

A 

1 

36 

78 

2.12 

0.27 

0.94 

0.45 

8 

7 

23105 

B 

0 

1 

2 

-1.04 

0.00 

0.14 

-0.24 

8 

7 

23105 

C 

0 

9 

20 

0.41 

0.38 

1.01 

-0.38 

8 

7 

23105 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

8 

2MD612 

* 

-1 

3925 

98 

1.50 

0.02 

0.00 

-0.07 

8 

8 

2MD612 

A 

1 

56 

84 

2.51 

0.17 

0.95 

0.45 

8 

8 

2MD612 

B 

0 

10 

15 

0.83 

0.29 

0.61 

-0.44 

8 

8 

2MD612 

C 

0 

1 

1 

1.37 

0.00 

0.73 

-0.08 

8 

8 

2MD612 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

9 

2MD21 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

8 

9 

2MD21 

A 

1 

45 

58 

1.87 

0.18 

1.14 

0.45 

8 

9 

2MD21 

B 

0 

10 

13 

1.21 

0.18 

1.10 

-0.06 

8 

9 

2MD21 

C 

0 

23 

29 

0.60 

0.16 

0.69 

-0.44 

8 

9 

2MD21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

10 

23280 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

8 

10 

23280 

A 

1 

19 

42 

2.14 

0.26 

0.54 

0.69 

8 

10 

23280 

B 

0 

8 

18 

-0.01 

0.47 

0.96 

-0.33 

8 

10 

23280 

C 

0 

12 

27 

0.23 

0.30 

0.74 

-0.32 

8 

10 

23280 

D 

0 

6 

13 

0.19 

0.20 

0.50 

-0.22 

8 

11 

21639 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

8 

11 

21639 

A 

1 

41 

89 

1.63 

0.22 

1.06 

0.36 

8 

11 

21639 

B 

0 

2 

4 

0.01 

1.35 

1.07 

-0.21 

8 

11 

21639 

C 

0 

1 

2 

-0.85 

0.00 

0.22 

-0.23 

8 

11 

21639 

D 

0 

2 

4 

0.29 

0.39 

0.74 

-0.17 

8 

12 

2NBT213 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

8 

12 

2NBT213 

A 

1 

67 

88 

1.58 

0.13 

0.89 

0.35 

8 

12 

2NBT213 

B 

0 

2 

3 

-0.62 

0.13 

0.20 

-0.29 

8 

12 

2NBT213 

C 

0 

7 

9 

0.58 

0.47 

1.56 

-0.23 

8 

12 

2NBT213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

13 

21592 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

8 

13 

21592 

A 

1 

39 

85 

1.80 

0.20 

0.82 

0.48 

8 

13 

21592 

B 

0 

1 

2 

0.04 

0.00 

0.43 

-0.16 

8 

13 

21592 

C 

0 

4 

9 

0.42 

0.72 

1.51 

-0.24 

8 

13 

21592 

D 

0 

2 

4 

-1.12 

0.20 

0.14 

-0.40 

8 

14 

21579 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

8 

14 

21579 

A 

1 

35 

78 

1.39 

0.23 

0.97 

0.44 

8 

14 

21579 

B 

0 

5 

11 

-0.61 

0.40 

0.40 

-0.39 

8 

14 

21579 

C 

0 

4 

9 

0.91 

0.31 

1.64 

-0.03 

8 

14 

21579 

D 

0 

1 

2 

-2.57 

0.00 

0.04 

-0.36 

8 

15 

21612 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

8 

15 

21612 

A 

1 

32 

71 

1.75 

0.20 

0.90 

0.54 

8 

15 

21612 

B 

0 

7 

16 

0.76 

0.50 

2.37 

-0.15 

8 

15 

21612 

C 

0 

3 

7 

-0.47 

0.40 

0.29 

-0.32 

8 

15 

21612 

D 

0 

3 

7 

-1.18 

0.77 

0.19 

-0.45 

8 

16 

2NBT26 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

8 

16 

2NBT26 

A 

1 

46 

69 

2.49 

0.19 

0.78 

0.58 

8 

16 

2NBT26 

B 

0 

8 

12 

1.46 

0.39 

1.40 

-0.11 

8 

16 

2NBT26 

C 

0 

13 

19 

0.15 

0.18 

0.31 

-0.59 

8 

16 

2NBT26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

17 

21861 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

0.00 

8 

17 

21861 

A 

1 

20 

45 

2.91 

0.40 

0.93 

0.66 

8 

17 

21861 

B 

0 

21 

48 

0.52 

0.20 

0.91 

-0.55 

8 

17 

21861 

C 

0 

2 

5 

0.50 

1.59 

1.23 

-0.13 

8 

17 

21861 

D 

0 

1 

2 

-0.45 

0.00 

0.19 

-0.17 

8 

18 

22080 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

8 

18 

22080 

A 

1 

35 

80 

1.52 

0.26 

1.35 

0.31 

8 

18 

22080 

B 

0 

1 

2 

1.98 

0.00 

3.60 

0.07 

8 

18 

22080 

C 

0 

4 

9 

0.75 

0.67 

1.80 

-0.11 

8 

18 

22080 

D 

0 

4 

9 

-0.50 

0.68 

0.50 

-0.36 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

19 

22116 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

8 

19 

22116 

A 

1 

35 

78 

1.55 

0.24 

1.01 

0.36 

8 

19 

22116 

B 

0 

3 

7 

0.47 

0.60 

1.09 

-0.15 

8 

19 

22116 

C 

0 

5 

11 

0.63 

0.54 

1.37 

-0.16 

8 

19 

22116 

D 

0 

2 

4 

-0.67 

0.53 

0.27 

-0.29 

8 

20 

20A413 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.01 

8 

20 

20A413 

A 

1 

63 

79 

1.63 

0.13 

1.02 

0.32 

8 

20 

20A413 

B 

0 

8 

10 

0.64 

0.22 

0.67 

-0.26 

8 

20 

20A413 

C 

0 

9 

11 

0.98 

0.34 

1.25 

-0.17 

8 

20 

20A413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

21 

20A25 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.01 

8 

21 

20A25 

A 

1 

61 

76 

1.72 

0.13 

0.91 

0.45 

8 

21 

20A25 

B 

0 

8 

10 

0.48 

0.24 

0.56 

-0.31 

8 

21 

20A25 

C 

0 

11 

14 

0.71 

0.22 

0.73 

-0.29 

8 

21 

20A25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

22 

22339 

* 

-1 

3943 

99 

1.52 

0.02 

0.00 

0.00 

8 

22 

22339 

A 

1 

35 

71 

2.04 

0.22 

0.74 

0.55 

8 

22 

22339 

B 

0 

6 

12 

0.60 

0.71 

2.38 

-0.23 

8 

22 

22339 

C 

0 

2 

4 

0.00 

0.18 

0.36 

-0.21 

8 

22 

22339 

D 

0 

6 

12 

-0.13 

0.26 

0.39 

-0.41 

8 

23 

22303 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

8 

23 

22303 

A 

1 

29 

67 

1.88 

0.29 

1.20 

0.44 

8 

23 

22303 

B 

0 

6 

14 

0.42 

0.36 

0.91 

-0.25 

8 

23 

22303 

C 

0 

4 

9 

0.35 

0.54 

0.76 

-0.21 

8 

23 

22303 

D 

0 

4 

9 

0.43 

0.87 

2.20 

-0.20 

8 

24 

22166 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

8 

24 

22166 

A 

1 

27 

59 

1.94 

0.22 

0.59 

0.71 

8 

24 

22166 

B 

0 

3 

7 

-0.60 

0.42 

0.26 

-0.32 

8 

24 

22166 

C 

0 

10 

22 

0.10 

0.24 

0.56 

-0.38 

8 

24 

22166 

D 

0 

6 

13 

-0.07 

0.38 

0.55 

-0.33 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

8 

25 

22368 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

8 

25 

22368 

A 

1 

24 

53 

2.41 

0.31 

0.96 

0.52 

8 

25 

22368 

B 

0 

11 

24 

1.18 

0.46 

2.04 

-0.15 

8 

25 

22368 

C 

0 

5 

11 

0.57 

0.37 

0.64 

-0.23 

8 

25 

22368 

D 

0 

5 

11 

-0.13 

0.39 

0.32 

-0.38 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

1 

2G318 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

9 

1 

2G318 

A 

1 

77 

93 

1.59 

0.11 

0.93 

0.34 

9 

1 

2G318 

B 

0 

4 

5 

0.34 

0.48 

0.63 

-0.25 

9 

1 

2G318 

C 

0 

2 

2 

-0.03 

0.33 

0.34 

-0.23 

9 

1 

2G318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

2 

2G231 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.02 

9 

2 

2G231 

A 

1 

75 

90 

1.33 

0.10 

1.08 

0.13 

9 

2 

2G231 

B 

0 

2 

2 

0.52 

0.53 

0.70 

-0.14 

9 

2 

2G231 

C 

0 

6 

7 

1.09 

0.34 

1.55 

-0.07 

9 

2 

2G231 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

3 

2G338 

* 

-1 

3911 

98 

1.52 

0.02 

0.00 

0.02 

9 

3 

2G338 

A 

1 

57 

70 

1.49 

0.11 

0.98 

0.37 

9 

3 

2G338 

B 

0 

4 

5 

0.30 

0.48 

0.60 

-0.26 

9 

3 

2G338 

C 

0 

20 

25 

0.91 

0.16 

0.93 

-0.25 

9 

3 

2G338 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

4 

23362 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

9 

4 

23362 

A 

1 

38 

84 

1.84 

0.26 

1.18 

0.46 

9 

4 

23362 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

4 

23362 

C 

0 

5 

11 

-0.14 

0.41 

0.60 

-0.34 

9 

4 

23362 

D 

0 

2 

4 

-0.74 

0.29 

0.26 

-0.29 

9 

5 

23356 

* 

-1 

3805 

95 

1.51 

0.02 

0.00 

-0.03 

9 

5 

23356 

A 

1 

158 

84 

1.98 

0.10 

0.84 

0.47 

9 

5 

23356 

B 

0 

5 

3 

-0.01 

0.30 

0.39 

-0.21 

9 

5 

23356 

C 

0 

21 

11 

0.38 

0.25 

1.00 

-0.35 

9 

5 

23356 

D 

0 

3 

2 

-0.63 

0.15 

0.17 

-0.22 

9 

6 

23034 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

9 

6 

23034 

A 

1 

36 

80 

1.98 

0.27 

0.97 

0.45 

9 

6 

23034 

B 

0 

1 

2 

-0.14 

0.00 

0.33 

-0.14 

9 

6 

23034 

C 

0 

3 

7 

-0.24 

0.78 

0.47 

-0.27 

9 

6 

23034 

D 

0 

5 

11 

0.12 

1.03 

2.08 

-0.29 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

7 

23073 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

9 

7 

23073 

A 

1 

36 

78 

1.77 

0.22 

1.10 

0.39 

9 

7 

23073 

B 

0 

5 

11 

0.87 

0.41 

1.18 

-0.16 

9 

7 

23073 

C 

0 

2 

4 

0.68 

0.06 

0.69 

-0.13 

9 

7 

23073 

D 

0 

3 

7 

-0.22 

1.04 

0.77 

-0.34 

9 

8 

23240 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

9 

8 

23240 

A 

1 

32 

71 

2.00 

0.25 

0.81 

0.56 

9 

8 

23240 

B 

0 

3 

7 

-0.71 

0.76 

0.34 

-0.37 

9 

8 

23240 

C 

0 

6 

13 

-0.11 

0.36 

0.50 

-0.39 

9 

8 

23240 

D 

0 

4 

9 

0.88 

0.33 

1.14 

-0.11 

9 

9 

23304 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

9 

9 

23304 

A 

1 

26 

59 

2.60 

0.28 

0.63 

0.66 

9 

9 

23304 

B 

0 

5 

11 

0.93 

0.84 

2.80 

-0.14 

9 

9 

23304 

C 

0 

10 

23 

-0.13 

0.32 

0.41 

-0.53 

9 

9 

23304 

D 

0 

3 

7 

0.06 

0.42 

0.38 

-0.23 

9 

10 

2MD103 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

9 

10 

2MD103 

A 

1 

41 

59 

2.59 

0.15 

0.75 

0.63 

9 

10 

2MD103 

B 

0 

5 

7 

0.84 

0.27 

0.40 

-0.28 

9 

10 

2MD103 

C 

0 

23 

33 

1.20 

0.18 

0.74 

-0.50 

9 

10 

2MD103 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

11 

21656 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

9 

11 

21656 

A 

1 

40 

89 

1.39 

0.19 

0.90 

0.40 

9 

11 

21656 

B 

0 

2 

4 

0.50 

0.32 

0.88 

-0.12 

9 

11 

21656 

C 

0 

3 

7 

-0.70 

0.41 

0.29 

-0.40 

9 

11 

21656 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

12 

2NBT212 

* 

-1 

3910 

98 

1.52 

0.02 

0.00 

0.00 

9 

12 

2NBT212 

A 

1 

73 

89 

1.59 

0.12 

0.95 

0.35 

9 

12 

2NBT212 

B 

0 

4 

5 

0.13 

0.46 

0.50 

-0.30 

9 

12 

2NBT212 

C 

0 

5 

6 

0.69 

0.25 

0.75 

-0.19 

9 

12 

2NBT212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

13 

21699 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

9 

13 

21699 

A 

1 

40 

89 

1.84 

0.19 

1.08 

0.27 

9 

13 

21699 

B 

0 

4 

9 

0.90 

0.25 

0.73 

-0.23 

9 

13 

21699 

C 

0 

1 

2 

0.74 

0.00 

0.57 

-0.13 

9 

13 

21699 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

14 

21714 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

9 

14 

21714 

A 

1 

36 

82 

2.07 

0.28 

0.94 

0.49 

9 

14 

21714 

B 

0 

2 

5 

-0.44 

0.39 

0.34 

-0.25 

9 

14 

21714 

C 

0 

4 

9 

0.20 

0.78 

1.24 

-0.25 

9 

14 

21714 

D 

0 

2 

5 

-0.89 

0.61 

0.24 

-0.30 

9 

15 

2NBT311 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

9 

15 

2NBT311 

A 

1 

68 

85 

2.53 

0.14 

0.89 

0.43 

9 

15 

2NBT311 

B 

0 

8 

10 

1.06 

0.49 

1.06 

-0.31 

9 

15 

2NBT311 

C 

0 

4 

5 

0.70 

0.44 

0.46 

-0.28 

9 

15 

2NBT311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

16 

2NBT714 

* 

-1 

3857 

97 

1.50 

0.02 

0.00 

-0.06 

9 

16 

2NBT714 

A 

1 

94 

70 

2.42 

0.14 

1.15 

0.47 

9 

16 

2NBT714 

B 

0 

15 

11 

0.89 

0.20 

0.62 

-0.27 

9 

16 

2NBT714 

C 

0 

26 

19 

1.00 

0.22 

0.97 

-0.33 

9 

16 

2NBT714 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

17 

21799 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

9 

17 

21799 

A 

1 

22 

48 

2.88 

0.28 

0.52 

0.74 

9 

17 

21799 

B 

0 

13 

28 

0.77 

0.24 

0.65 

-0.36 

9 

17 

21799 

C 

0 

8 

17 

0.30 

0.30 

0.39 

-0.40 

9 

17 

21799 

D 

0 

3 

7 

0.32 

0.26 

0.33 

-0.23 

9 

18 

22197 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

9 

18 

22197 

A 

1 

37 

82 

1.81 

0.26 

1.10 

0.36 

9 

18 

22197 

B 

0 

3 

7 

0.40 

0.92 

1.50 

-0.18 

9 

18 

22197 

C 

0 

2 

4 

0.25 

1.27 

1.06 

-0.17 

9 

18 

22197 

D 

0 

3 

7 

0.13 

1.03 

1.22 

-0.23 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

19 

22264 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

9 

19 

22264 

A 

1 

35 

78 

1.90 

0.26 

0.81 

0.50 

9 

19 

22264 

B 

0 

3 

7 

0.05 

0.90 

1.15 

-0.22 

9 

19 

22264 

C 

0 

5 

11 

-0.35 

0.63 

0.89 

-0.38 

9 

19 

22264 

D 

0 

2 

4 

0.16 

1.04 

0.90 

-0.17 

9 

20 

20A219 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

9 

20 

20A219 

A 

1 

68 

80 

1.90 

0.13 

0.83 

0.52 

9 

20 

20A219 

B 

0 

11 

13 

0.44 

0.20 

0.53 

-0.40 

9 

20 

20A219 

C 

0 

6 

7 

0.41 

0.28 

0.53 

-0.29 

9 

20 

20A219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

21 

22055 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

9 

21 

22055 

A 

1 

34 

77 

2.02 

0.22 

0.86 

0.45 

9 

21 

22055 

B 

0 

5 

11 

0.70 

0.63 

1.14 

-0.24 

9 

21 

22055 

C 

0 

2 

5 

-0.19 

1.96 

0.91 

-0.28 

9 

21 

22055 

D 

0 

3 

7 

0.49 

0.36 

0.56 

-0.22 

9 

22 

20  A3  8 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

9 

22 

20A38 

A 

1 

53 

80 

2.47 

0.17 

0.84 

0.52 

9 

22 

20A38 

B 

0 

5 

8 

0.79 

0.17 

0.47 

-0.27 

9 

22 

20  A3  8 

C 

0 

8 

12 

0.60 

0.45 

0.76 

-0.41 

9 

22 

20  A3  8 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

23 

22290 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

9 

23 

22290 

A 

1 

31 

69 

1.73 

0.20 

0.92 

0.45 

9 

23 

22290 

B 

0 

2 

4 

-1.16 

0.58 

0.13 

-0.41 

9 

23 

22290 

C 

0 

6 

13 

1.46 

0.40 

2.18 

0.04 

9 

23 

22290 

D 

0 

6 

13 

0.02 

0.47 

0.67 

-0.40 

9 

24 

22338 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

9 

24 

22338 

A 

1 

31 

69 

2.38 

0.25 

0.80 

0.60 

9 

24 

22338 

B 

0 

5 

11 

0.77 

0.40 

0.80 

-0.24 

9 

24 

22338 

C 

0 

2 

4 

-0.09 

0.57 

0.30 

-0.27 

9 

24 

22338 

D 

0 

7 

16 

0.38 

0.20 

0.48 

-0.40 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

9 

25 

22387 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

9 

25 

22387 

A 

1 

23 

51 

2.28 

0.22 

0.61 

0.64 

9 

25 

22387 

B 

0 

5 

11 

1.43 

0.27 

1.21 

-0.01 

9 

25 

22387 

C 

0 

7 

16 

0.28 

0.43 

0.56 

-0.38 

9 

25 

22387 

D 

0 

10 

22 

0.40 

0.31 

0.52 

-0.43 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

1 

2G325 

* 

-1 

3906 

98 

1.51 

0.02 

0.00 

-0.01 

10 

1 

2G325 

A 

1 

80 

93 

1.67 

0.13 

1.01 

0.20 

10 

1 

2G325 

B 

0 

3 

3 

0.71 

0.32 

0.71 

-0.15 

10 

1 

2G325 

C 

0 

3 

3 

0.90 

0.74 

1.31 

-0.12 

10 

1 

2G325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

2 

2G128 

* 

-1 

3920 

98 

1.51 

0.02 

0.00 

-0.05 

10 

2 

2G128 

A 

1 

68 

94 

2.13 

0.14 

1.05 

0.17 

10 

2 

2G128 

B 

0 

1 

1 

0.79 

0.00 

0.49 

-0.13 

10 

2 

2G128 

C 

0 

3 

4 

1.38 

0.58 

1.21 

-0.12 

10 

2 

2G128 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

3 

2G133 

* 

-1 

3900 

98 

1.51 

0.02 

0.00 

-0.03 

10 

3 

2G133 

A 

1 

66 

72 

2.09 

0.15 

1.13 

0.36 

10 

3 

2G133 

B 

0 

25 

27 

1.15 

0.18 

0.96 

-0.34 

10 

3 

2G133 

C 

0 

1 

1 

0.46 

0.00 

0.35 

-0.12 

10 

3 

2G133 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

4 

23331 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

10 

4 

23331 

A 

1 

38 

84 

1.53 

0.23 

0.98 

0.38 

10 

4 

23331 

B 

0 

4 

9 

-0.04 

0.63 

0.91 

-0.29 

10 

4 

23331 

C 

0 

2 

4 

-0.27 

0.74 

0.50 

-0.23 

10 

4 

23331 

D 

0 

1 

2 

0.74 

0.00 

1.06 

-0.06 

10 

5 

23163 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

10 

5 

23163 

A 

1 

36 

80 

1.67 

0.24 

1.03 

0.45 

10 

5 

23163 

B 

0 

2 

4 

-1.49 

0.66 

0.13 

-0.41 

10 

5 

23163 

C 

0 

7 

16 

0.39 

0.24 

0.81 

-0.27 

10 

5 

23163 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

6 

23377 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

0.00 

10 

6 

23377 

A 

1 

35 

81 

1.95 

0.23 

0.92 

0.54 

10 

6 

23377 

B 

0 

1 

2 

-0.58 

0.00 

0.21 

-0.23 

10 

6 

23377 

C 

0 

5 

12 

0.24 

0.21 

0.52 

-0.33 

10 

6 

23377 

D 

0 

2 

5 

-0.73 

0.02 

0.19 

-0.34 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

7 

23056 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

10 

7 

23056 

A 

1 

34 

76 

1.86 

0.30 

1.02 

0.38 

10 

7 

23056 

B 

0 

2 

4 

0.26 

0.37 

0.58 

-0.16 

10 

7 

23056 

C 

0 

4 

9 

0.89 

0.59 

1.76 

-0.11 

10 

7 

23056 

D 

0 

5 

11 

0.03 

0.18 

0.46 

-0.31 

10 

8 

2MD77 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

10 

8 

2MD77 

A 

1 

52 

74 

1.65 

0.15 

1.05 

0.34 

10 

8 

2MD77 

B 

0 

6 

9 

0.68 

0.49 

1.07 

-0.21 

10 

8 

2MD77 

C 

0 

12 

17 

0.84 

0.26 

1.05 

-0.24 

10 

8 

2MD77 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

9 

23332 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

10 

9 

23332 

A 

1 

28 

62 

1.90 

0.21 

0.96 

0.38 

10 

9 

23332 

B 

0 

6 

13 

0.72 

0.53 

0.83 

-0.27 

10 

9 

23332 

C 

0 

9 

20 

1.20 

0.38 

1.63 

-0.14 

10 

9 

23332 

D 

0 

2 

4 

0.58 

0.81 

0.62 

-0.17 

10 

10 

2MD414 

* 

-1 

3915 

98 

1.52 

0.02 

0.00 

0.01 

10 

10 

2MD414 

A 

1 

37 

48 

2.05 

0.19 

0.90 

0.51 

10 

10 

2MD414 

B 

0 

25 

32 

0.98 

0.17 

0.94 

-0.28 

10 

10 

2MD414 

C 

0 

15 

19 

0.71 

0.21 

0.69 

-0.31 

10 

10 

2MD414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

11 

2NBT82 

* 

-1 

3851 

96 

1.50 

0.02 

0.00 

-0.04 

10 

11 

2NBT82 

A 

1 

131 

93 

1.89 

0.11 

1.02 

0.24 

10 

11 

2NBT82 

B 

0 

5 

4 

0.91 

0.53 

1.31 

-0.13 

10 

11 

2NBT82 

C 

0 

5 

4 

0.38 

0.19 

0.49 

-0.21 

10 

11 

2NBT82 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

12 

21515 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

10 

12 

21515 

A 

1 

40 

87 

1.92 

0.25 

1.03 

0.33 

10 

12 

21515 

B 

0 

2 

4 

0.41 

1.06 

1.09 

-0.17 

10 

12 

21515 

C 

0 

2 

4 

1.54 

1.05 

3.34 

-0.02 

10 

12 

21515 

D 

0 

2 

4 

-1.03 

0.96 

0.24 

-0.35 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

13 

21791 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

10 

13 

21791 

A 

1 

36 

80 

1.60 

0.23 

0.74 

0.55 

10 

13 

21791 

B 

0 

2 

4 

0.32 

0.99 

1.22 

-0.12 

10 

13 

21791 

C 

0 

3 

7 

-1.02 

0.37 

0.23 

-0.38 

10 

13 

21791 

D 

0 

4 

9 

-0.59 

0.53 

0.48 

-0.36 

10 

14 

21728 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

10 

14 

21728 

A 

1 

35 

78 

1.56 

0.26 

0.99 

0.47 

10 

14 

21728 

B 

0 

3 

7 

-0.68 

1.21 

0.67 

-0.29 

10 

14 

21728 

C 

0 

6 

13 

0.08 

0.30 

0.78 

-0.25 

10 

14 

21728 

D 

0 

1 

2 

-2.01 

0.00 

0.08 

-0.28 

10 

15 

21603 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

10 

15 

21603 

A 

1 

33 

75 

2.16 

0.22 

0.67 

0.63 

10 

15 

21603 

B 

0 

7 

16 

0.07 

0.52 

0.78 

-0.42 

10 

15 

21603 

C 

0 

4 

9 

-0.41 

0.56 

0.32 

-0.41 

10 

15 

21603 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

16 

2NBT76 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

10 

16 

2NBT76 

A 

1 

46 

69 

2.38 

0.21 

1.17 

0.47 

10 

16 

2NBT76 

B 

0 

20 

30 

0.94 

0.21 

0.80 

-0.44 

10 

16 

2NBT76 

C 

0 

1 

1 

0.06 

0.00 

0.23 

-0.16 

10 

16 

2NBT76 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

17 

21820 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

10 

17 

21820 

A 

1 

22 

49 

2.39 

0.35 

1.23 

0.46 

10 

17 

21820 

B 

0 

16 

36 

1.12 

0.32 

1.20 

-0.22 

10 

17 

21820 

C 

0 

3 

7 

-0.15 

0.53 

0.25 

-0.29 

10 

17 

21820 

D 

0 

4 

9 

0.68 

0.97 

1.01 

-0.18 

10 

18 

22123 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

10 

18 

22123 

A 

1 

37 

80 

1.59 

0.24 

1.47 

0.35 

10 

18 

22123 

B 

0 

3 

7 

-0.05 

0.48 

0.57 

-0.24 

10 

18 

22123 

C 

0 

4 

9 

0.68 

0.60 

1.51 

-0.13 

10 

18 

22123 

D 

0 

2 

4 

-0.11 

1.77 

1.29 

-0.20 

easyCBM  CCSS  Second  Grade  Math  Measure  Development 


134 

Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

19 

22379 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

10 

19 

22379 

A 

1 

35 

78 

1.54 

0.20 

0.84 

0.47 

10 

19 

22379 

B 

0 

2 

4 

1.75 

0.09 

2.61 

0.09 

10 

19 

22379 

C 

0 

1 

2 

0.30 

0.00 

0.61 

-0.10 

10 

19 

22379 

D 

0 

7 

16 

-0.54 

0.45 

0.41 

-0.55 

10 

20 

20A312 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

10 

20 

20A312 

A 

1 

68 

80 

1.82 

0.13 

0.94 

0.38 

10 

20 

20A312 

B 

0 

12 

14 

0.62 

0.22 

0.68 

-0.35 

10 

20 

20A312 

C 

0 

5 

6 

1.08 

0.60 

1.58 

-0.12 

10 

20 

20A312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

21 

22085 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

10 

21 

22085 

A 

1 

33 

73 

1.65 

0.19 

0.97 

0.44 

10 

21 

22085 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

21 

22085 

C 

0 

10 

22 

0.20 

0.33 

0.65 

-0.50 

10 

21 

22085 

D 

0 

2 

4 

1.72 

0.19 

1.99 

0.07 

10 

22 

22399 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

10 

22 

22399 

A 

1 

30 

67 

1.58 

0.27 

1.55 

0.42 

10 

22 

22399 

B 

0 

3 

7 

-0.15 

0.83 

0.71 

-0.22 

10 

22 

22399 

C 

0 

9 

20 

1.00 

0.17 

1.25 

-0.04 

10 

22 

22399 

D 

0 

3 

7 

-1.90 

0.48 

0.08 

-0.52 

10 

23 

22213 

* 

-1 

3945 

99 

1.52 

0.02 

0.00 

0.02 

10 

23 

22213 

A 

1 

30 

64 

1.87 

0.26 

0.92 

0.59 

10 

23 

22213 

B 

0 

3 

6 

0.05 

0.51 

0.58 

-0.19 

10 

23 

22213 

C 

0 

6 

13 

-0.08 

0.42 

0.60 

-0.31 

10 

23 

22213 

D 

0 

8 

17 

-0.04 

0.36 

0.65 

-0.36 

10 

24 

20  A3  5 

* 

-1 

3919 

98 

1.52 

0.02 

0.00 

0.02 

10 

24 

20  A3  5 

A 

1 

48 

66 

1.48 

0.11 

1.04 

0.22 

10 

24 

20  A3  5 

B 

0 

15 

21 

1.17 

0.27 

1.51 

-0.11 

10 

24 

20A35 

C 

0 

10 

14 

0.99 

0.25 

1.00 

-0.17 

10 

24 

20  A3  5 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

10 

25 

22202 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

10 

25 

22202 

A 

1 

21 

47 

2.18 

0.32 

1.13 

0.44 

10 

25 

22202 

B 

0 

12 

27 

0.62 

0.48 

2.13 

-0.32 

10 

25 

22202 

C 

0 

5 

11 

1.09 

0.57 

1.50 

-0.08 

10 

25 

22202 

D 

0 

7 

16 

0.90 

0.42 

0.98 

-0.15 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

1 

2G213 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

BMF 

1 

2G213 

A 

1 

79 

94 

1.65 

0.13 

1.01 

0.25 

BMF 

1 

2G213 

B 

0 

4 

5 

0.53 

0.33 

0.67 

-0.20 

BMF 

1 

2G213 

C 

0 

1 

1 

0.03 

0.00 

0.35 

-0.15 

BMF 

1 

2G213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

2 

2G335 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

BMF 

2 

2G335 

A 

1 

75 

89 

1.73 

0.13 

0.90 

0.38 

BMF 

2 

2G335 

B 

0 

8 

10 

0.25 

0.34 

0.66 

-0.37 

BMF 

2 

2G335 

C 

0 

1 

1 

0.86 

0.00 

0.76 

-0.07 

BMF 

2 

2G335 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

3 

2G230 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

BMF 

3 

2G230 

A 

1 

75 

77 

2.15 

0.13 

1.15 

0.36 

BMF 

3 

2G230 

B 

0 

6 

6 

0.88 

0.42 

0.69 

-0.24 

BMF 

3 

2G230 

C 

0 

17 

17 

1.31 

0.21 

1.01 

-0.25 

BMF 

3 

2G230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

4 

23018 

* 

-1 

3941 

99 

1.51 

0.02 

0.00 

-0.05 

BMF 

4 

23018 

A 

1 

46 

90 

2.31 

0.24 

1.04 

0.35 

BMF 

4 

23018 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

4 

23018 

C 

0 

4 

8 

0.63 

0.42 

0.78 

-0.26 

BMF 

4 

23018 

D 

0 

1 

2 

-0.64 

0.00 

0.17 

-0.24 

BMF 

5 

23158 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

BMF 

5 

23158 

A 

1 

37 

82 

2.06 

0.25 

0.77 

0.52 

BMF 

5 

23158 

B 

0 

6 

13 

0.13 

0.38 

0.70 

-0.36 

BMF 

5 

23158 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

5 

23158 

D 

0 

2 

4 

-1.05 

0.38 

0.16 

-0.35 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

6 

23283 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.02 

BMF 

6 

23283 

A 

1 

36 

82 

2.15 

0.25 

0.85 

0.54 

BMF 

6 

23283 

B 

0 

2 

5 

0.85 

0.32 

0.98 

-0.12 

BMF 

6 

23283 

C 

0 

5 

11 

-0.32 

0.36 

0.38 

-0.45 

BMF 

6 

23283 

D 

0 

1 

2 

-1.27 

0.00 

0.11 

-0.28 

BMF 

7 

23373 

* 

-1 

1491 

37 

1.64 

0.03 

0.00 

0.07 

BMF 

7 

23373 

A 

1 

1902 

76 

1.84 

0.03 

1.11 

0.47 

BMF 

7 

23373 

B 

0 

214 

9 

0.31 

0.08 

1.13 

-0.23 

BMF 

7 

23373 

C 

0 

249 

10 

0.19 

0.07 

0.91 

-0.27 

BMF 

7 

23373 

D 

0 

136 

5 

-0.14 

0.11 

0.62 

-0.25 

BMF 

8 

2MD1010 

* 

-1 

3920 

98 

1.52 

0.02 

0.00 

0.01 

BMF 

8 

2MD1010 

A 

1 

51 

71 

1.81 

0.20 

0.97 

0.49 

BMF 

8 

2MD1010 

B 

0 

13 

18 

0.14 

0.19 

0.57 

-0.40 

BMF 

8 

2MD1010 

C 

0 

8 

11 

0.45 

0.24 

0.79 

-0.22 

BMF 

8 

2MD1010 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

9 

2MD56 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

BMF 

9 

2MD56 

A 

1 

43 

62 

1.97 

0.16 

0.95 

0.50 

BMF 

9 

2MD56 

B 

0 

9 

13 

1.02 

0.28 

0.92 

-0.20 

BMF 

9 

2MD56 

C 

0 

17 

25 

0.83 

0.14 

0.64 

-0.41 

BMF 

9 

2MD56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

10 

23234 

* 

-1 

3950 

99 

1.52 

0.02 

0.00 

0.02 

BMF 

10 

23234 

A 

1 

19 

45 

1.79 

0.29 

1.34 

0.43 

BMF 

10 

23234 

B 

0 

8 

19 

0.73 

0.30 

0.82 

-0.16 

BMF 

10 

23234 

C 

0 

14 

33 

0.71 

0.36 

1.25 

-0.25 

BMF 

10 

23234 

D 

0 

1 

2 

-0.89 

0.00 

0.12 

-0.24 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

11 

21687 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

BMF 

11 

21687 

A 

1 

39 

87 

1.51 

0.22 

0.92 

0.49 

BMF 

11 

21687 

B 

0 

2 

4 

-0.83 

0.42 

0.28 

-0.29 

BMF 

11 

21687 

C 

0 

3 

7 

-0.81 

0.87 

0.52 

-0.36 

BMF 

11 

21687 

D 

0 

1 

2 

0.18 

0.00 

0.71 

-0.10 

BMF 

12 

2NBT315 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

BMF 

12 

2NBT315 

A 

1 

62 

90 

1.70 

0.13 

0.95 

0.37 

BMF 

12 

2NBT315 

B 

0 

5 

7 

0.41 

0.13 

0.47 

-0.31 

BMF 

12 

2NBT315 

C 

0 

2 

3 

0.43 

0.13 

0.47 

-0.19 

BMF 

12 

2NBT315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

13 

21634 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

BMF 

13 

21634 

A 

1 

38 

86 

1.92 

0.23 

0.86 

0.43 

BMF 

13 

21634 

B 

0 

2 

5 

0.34 

0.68 

0.64 

-0.20 

BMF 

13 

21634 

C 

0 

3 

7 

0.11 

0.19 

0.43 

-0.29 

BMF 

13 

21634 

D 

0 

1 

2 

-0.62 

0.00 

0.20 

-0.24 

BMF 

14 

21569 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

BMF 

14 

21569 

A 

1 

37 

84 

1.80 

0.22 

0.97 

0.43 

BMF 

14 

21569 

B 

0 

4 

9 

0.21 

0.22 

0.48 

-0.31 

BMF 

14 

21569 

C 

0 

2 

5 

-0.16 

0.75 

0.40 

-0.28 

BMF 

14 

21569 

D 

0 

1 

2 

1.00 

0.00 

0.98 

-0.06 

BMF 

15 

2NBT35 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

BMF 

15 

2NBT35 

A 

1 

73 

80 

2.10 

0.13 

0.81 

0.52 

BMF 

15 

2NBT35 

B 

0 

11 

12 

0.83 

0.27 

0.75 

-0.30 

BMF 

15 

2NBT35 

C 

0 

7 

8 

0.12 

0.20 

0.30 

-0.41 

BMF 

15 

2NBT35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

16 

2NBT67 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

BMF 

16 

2NBT67 

A 

1 

56 

66 

1.99 

0.15 

0.95 

0.47 

BMF 

16 

2NBT67 

B 

0 

10 

12 

0.73 

0.23 

0.63 

-0.28 

BMF 

16 

2NBT67 

C 

0 

19 

22 

0.94 

0.19 

0.87 

-0.32 

BMF 

16 

2NBT67 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

17 

21894 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

BMF 

17 

21894 

A 

1 

18 

41 

2.46 

0.35 

0.64 

0.62 

BMF 

17 

21894 

B 

0 

11 

25 

-0.17 

0.27 

0.40 

-0.50 

BMF 

17 

21894 

C 

0 

10 

23 

0.54 

0.27 

0.76 

-0.23 

BMF 

17 

21894 

D 

0 

5 

11 

1.41 

0.66 

3.62 

0.04 

BMF 

18 

2OA210 

* 

-1 

3902 

98 

1.51 

0.02 

0.00 

-0.03 

BMF 

18 

2OA210 

A 

1 

79 

88 

1.90 

0.13 

1.05 

0.27 

BMF 

18 

2OA210 

B 

0 

6 

7 

0.49 

0.31 

0.55 

-0.29 

BMF 

18 

2OA210 

C 

0 

5 

6 

1.41 

0.30 

1.36 

-0.07 

BMF 

18 

2OA210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

19 

20A431 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

BMF 

19 

20A431 

A 

1 

54 

78 

1.74 

0.19 

0.91 

0.46 

BMF 

19 

20A431 

B 

0 

8 

12 

0.03 

0.20 

0.50 

-0.34 

BMF 

19 

20A431 

C 

0 

7 

10 

0.19 

0.28 

0.64 

-0.28 

BMF 

19 

20A431 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

20 

22209 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

BMF 

20 

22209 

A 

1 

33 

77 

1.81 

0.20 

1.06 

0.52 

BMF 

20 

22209 

B 

0 

1 

2 

-1.04 

0.00 

0.12 

-0.29 

BMF 

20 

22209 

C 

0 

4 

9 

1.12 

0.27 

1.13 

-0.08 

BMF 

20 

22209 

D 

0 

5 

12 

-0.24 

0.54 

0.42 

-0.47 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

21 

22351 

* 

-1 

3794 

95 

1.52 

0.02 

0.00 

0.00 

BMF 

21 

22351 

A 

1 

150 

76 

1.73 

0.10 

1.09 

0.35 

BMF 

21 

22351 

B 

0 

21 

11 

0.98 

0.15 

1.04 

-0.14 

BMF 

21 

22351 

C 

0 

19 

10 

1.04 

0.19 

1.23 

-0.12 

BMF 

21 

22351 

D 

0 

8 

4 

-0.69 

0.52 

0.26 

-0.36 

BMF 

22 

22265 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

BMF 

22 

22265 

A 

1 

30 

65 

1.73 

0.23 

0.70 

0.61 

BMF 

22 

22265 

B 

0 

6 

13 

0.05 

0.51 

0.91 

-0.27 

BMF 

22 

22265 

C 

0 

2 

4 

-0.72 

0.23 

0.23 

-0.26 

BMF 

22 

22265 

D 

0 

8 

17 

-0.14 

0.29 

0.57 

-0.38 

BMF 

23 

22183 

* 

-1 

1471 

37 

1.65 

0.03 

0.00 

0.07 

BMF 

23 

22183 

A 

1 

1723 

68 

1.97 

0.03 

0.99 

0.51 

BMF 

23 

22183 

B 

0 

174 

7 

0.17 

0.08 

0.81 

-0.23 

BMF 

23 

22183 

C 

0 

208 

8 

0.49 

0.08 

0.99 

-0.19 

BMF 

23 

22183 

D 

0 

416 

17 

0.26 

0.06 

0.83 

-0.34 

BMF 

24 

22156 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

BMF 

24 

22156 

A 

1 

28 

62 

1.91 

0.19 

0.75 

0.68 

BMF 

24 

22156 

B 

0 

5 

11 

-0.06 

0.42 

0.42 

-0.39 

BMF 

24 

22156 

C 

0 

5 

11 

0.37 

0.43 

0.69 

-0.27 

BMF 

24 

22156 

D 

0 

7 

16 

0.32 

0.16 

0.49 

-0.34 

BMF 

25 

22344 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

BMF 

25 

22344 

A 

1 

19 

43 

2.28 

0.34 

0.72 

0.61 

BMF 

25 

22344 

B 

0 

5 

11 

0.84 

0.19 

0.77 

-0.13 

BMF 

25 

22344 

C 

0 

11 

25 

0.48 

0.28 

0.70 

-0.35 

BMF 

25 

22344 

D 

0 

9 

20 

0.59 

0.15 

0.62 

-0.27 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

26 

3NF29 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

BMF 

26 

3NF29 

A 

1 

98 

92 

1.88 

0.10 

0.98 

0.26 

BMF 

26 

3NF29 

B 

0 

5 

5 

0.92 

0.72 

1.44 

-0.19 

BMF 

26 

3NF29 

C 

0 

3 

3 

0.68 

0.45 

0.61 

-0.18 

BMF 

26 

3NF29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

27 

3G119 

* 

-1 

4769 

95 

1.17 

0.02 

0.00 

-0.11 

BMF 

27 

3G119 

A 

1 

202 

90 

2.00 

0.07 

0.92 

0.37 

BMF 

27 

3G119 

B 

0 

18 

8 

0.81 

0.19 

0.70 

-0.29 

BMF 

27 

3G119 

C 

0 

5 

2 

0.31 

0.45 

0.45 

-0.22 

BMF 

27 

3G119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

28 

3NBT13 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

BMF 

28 

3NBT13 

A 

1 

91 

78 

2.11 

0.12 

0.90 

0.47 

BMF 

28 

3NBT13 

B 

0 

9 

8 

0.90 

0.26 

0.72 

-0.23 

BMF 

28 

3NBT13 

C 

0 

17 

15 

0.73 

0.13 

0.55 

-0.39 

BMF 

28 

3NBT13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

29 

3MD26 

* 

-1 

4877 

98 

1.19 

0.02 

0.00 

-0.07 

BMF 

29 

3MD26 

A 

1 

80 

68 

2.21 

0.13 

0.91 

0.49 

BMF 

29 

3MD26 

B 

0 

16 

14 

0.77 

0.14 

0.52 

-0.36 

BMF 

29 

3MD26 

C 

0 

21 

18 

1.13 

0.17 

0.85 

-0.28 

BMF 

29 

3MD26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

30 

3NF317 

* 

-1 

4888 

98 

1.20 

0.02 

0.00 

-0.04 

BMF 

30 

3NF317 

A 

1 

56 

53 

2.23 

0.15 

0.88 

0.55 

BMF 

30 

3NF317 

B 

0 

16 

15 

0.82 

0.29 

0.86 

-0.28 

BMF 

30 

3NF317 

C 

0 

34 

32 

0.97 

0.12 

0.71 

-0.37 

BMF 

30 

3NF317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMF 

31 

10083 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

BMF 

31 

10083 

A 

1 

21 

88 

1.41 

0.36 

1.10 

0.21 

BMF 

31 

10083 

B 

0 

1 

4 

1.65 

0.00 

2.95 

0.05 

BMF 

31 

10083 

C 

0 

2 

8 

-0.21 

0.25 

0.47 

-0.29 

BMF 

31 

10083 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

32 

1MD226 

* 

-1 

1739 

92 

1.51 

0.03 

0.00 

-0.03 

BMF 

32 

1MD226 

A 

1 

137 

88 

1.73 

0.09 

1.02 

0.23 

BMF 

32 

1MD226 

B 

0 

8 

5 

1.18 

0.24 

1.11 

-0.10 

BMF 

32 

1MD226 

C 

0 

10 

6 

0.86 

0.29 

0.90 

-0.20 

BMF 

32 

1MD226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

33 

1NBT58 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

BMF 

33 

1NBT58 

A 

1 

65 

81 

1.95 

0.13 

0.82 

0.52 

BMF 

33 

1NBT58 

B 

0 

8 

10 

0.37 

0.23 

0.48 

-0.36 

BMF 

33 

1NBT58 

C 

0 

7 

9 

0.34 

0.41 

0.62 

-0.34 

BMF 

33 

1NBT58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

34 

1NBT528 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.04 

BMF 

34 

1NBT528 

A 

1 

43 

61 

2.18 

0.17 

1.05 

0.40 

BMF 

34 

1NBT528 

B 

0 

16 

23 

1.16 

0.24 

0.94 

-0.30 

BMF 

34 

1NBT528 

C 

0 

11 

16 

1.30 

0.36 

1.44 

-0.19 

BMF 

34 

1NBT528 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

35 

1MD231 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

BMF 

35 

1MD231 

A 

1 

39 

49 

2.24 

0.18 

0.96 

0.48 

BMF 

35 

1MD231 

B 

0 

13 

16 

1.47 

0.36 

1.49 

-0.07 

BMF 

35 

1MD231 

C 

0 

28 

35 

0.91 

0.14 

0.63 

-0.46 

BMF 

35 

1MD231 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMF  = Benchmark  Fall. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

1 

2G26 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

BMW 

1 

2G26 

A 

1 

79 

94 

1.63 

0.13 

1.00 

0.17 

BMW 

1 

2G26 

B 

0 

2 

2 

1.41 

0.09 

1.39 

-0.02 

BMW 

1 

2G26 

C 

0 

3 

4 

0.41 

0.81 

0.93 

-0.19 

BMW 

1 

2G26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

2 

2G18 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.01 

BMW 

2 

2G18 

A 

1 

65 

88 

1.46 

0.15 

1.15 

0.13 

BMW 

2 

2G18 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

2 

2G18 

C 

0 

9 

12 

0.99 

0.21 

1.26 

-0.13 

BMW 

2 

2G18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

3 

2G230 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

BMW 

3 

2G230 

A 

1 

75 

77 

2.15 

0.13 

1.15 

0.36 

BMW 

3 

2G230 

B 

0 

6 

6 

0.88 

0.42 

0.69 

-0.24 

BMW 

3 

2G230 

C 

0 

17 

17 

1.31 

0.21 

1.01 

-0.25 

BMW 

3 

2G230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

4 

23275 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

BMW 

4 

23275 

A 

1 

39 

85 

1.62 

0.21 

0.76 

0.50 

BMW 

4 

23275 

B 

0 

5 

11 

-0.82 

0.31 

0.26 

-0.52 

BMW 

4 

23275 

C 

0 

2 

4 

0.78 

1.12 

1.82 

-0.08 

BMW 

4 

23275 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

5 

23057 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

BMW 

5 

23057 

A 

1 

36 

82 

1.79 

0.17 

0.73 

0.61 

BMW 

5 

23057 

B 

0 

2 

5 

-0.79 

0.52 

0.19 

-0.38 

BMW 

5 

23057 

C 

0 

5 

11 

0.19 

0.54 

0.88 

-0.35 

BMW 

5 

23057 

D 

0 

1 

2 

-1.06 

0.00 

0.13 

-0.30 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

6 

23103 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

BMW 

6 

23103 

A 

1 

36 

80 

1.67 

0.21 

0.94 

0.51 

BMW 

6 

23103 

B 

0 

1 

2 

-0.56 

0.00 

0.23 

-0.21 

BMW 

6 

23103 

C 

0 

5 

11 

-0.27 

0.42 

0.43 

-0.43 

BMW 

6 

23103 

D 

0 

3 

7 

0.59 

0.18 

0.76 

-0.15 

BMW 

7 

23373 

* 

-1 

1491 

37 

1.64 

0.03 

0.00 

0.07 

BMW 

7 

23373 

A 

1 

1902 

76 

1.84 

0.03 

1.11 

0.47 

BMW 

7 

23373 

B 

0 

214 

9 

0.31 

0.08 

1.13 

-0.23 

BMW 

7 

23373 

C 

0 

249 

10 

0.19 

0.07 

0.91 

-0.27 

BMW 

7 

23373 

D 

0 

136 

5 

-0.14 

0.11 

0.62 

-0.25 

BMW 

8 

2MD313 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

BMW 

8 

2MD313 

A 

1 

63 

76 

1.72 

0.13 

0.96 

0.40 

BMW 

8 

2MD313 

B 

0 

8 

10 

0.58 

0.23 

0.64 

-0.29 

BMW 

8 

2MD313 

C 

0 

12 

14 

0.87 

0.25 

0.90 

-0.24 

BMW 

8 

2MD313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

9 

2MD52 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

BMW 

9 

2MD52 

A 

1 

45 

59 

1.92 

0.17 

0.95 

0.51 

BMW 

9 

2MD52 

B 

0 

24 

32 

0.70 

0.13 

0.68 

-0.43 

BMW 

9 

2MD52 

C 

0 

7 

9 

0.76 

0.45 

1.27 

-0.18 

BMW 

9 

2MD52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

10 

23308 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

BMW 

10 

23308 

A 

1 

22 

50 

2.11 

0.33 

1.36 

0.41 

BMW 

10 

23308 

B 

0 

6 

14 

1.57 

0.60 

3.42 

0.02 

BMW 

10 

23308 

C 

0 

14 

32 

0.79 

0.25 

0.79 

-0.33 

BMW 

10 

23308 

D 

0 

2 

5 

-0.38 

1.04 

0.28 

-0.28 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

11 

21529 

* 

-1 

3795 

95 

1.50 

0.02 

0.00 

-0.04 

BMW 

11 

21529 

A 

1 

180 

91 

1.92 

0.10 

0.95 

0.35 

BMW 

11 

21529 

B 

0 

7 

4 

0.16 

0.40 

0.63 

-0.21 

BMW 

11 

21529 

C 

0 

8 

4 

0.04 

0.29 

0.52 

-0.24 

BMW 

11 

21529 

D 

0 

2 

1 

0.02 

1.08 

0.62 

-0.12 

BMW 

12 

2NBT218 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

BMW 

12 

2NBT218 

A 

1 

90 

92 

2.06 

0.11 

0.90 

0.41 

BMW 

12 

2NBT218 

B 

0 

4 

4 

-0.36 

0.06 

0.17 

-0.42 

BMW 

12 

2NBT218 

C 

0 

4 

4 

1.10 

0.31 

0.84 

-0.15 

BMW 

12 

2NBT218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

13 

21510 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

BMW 

13 

21510 

A 

1 

35 

78 

1.42 

0.24 

0.90 

0.51 

BMW 

13 

21510 

B 

0 

2 

4 

-1.20 

0.79 

0.27 

-0.31 

BMW 

13 

21510 

C 

0 

6 

13 

-0.34 

0.31 

0.61 

-0.34 

BMW 

13 

21510 

D 

0 

2 

4 

-0.20 

1.37 

1.16 

-0.17 

BMW 

14 

2NBT31 

* 

-1 

3910 

98 

1.52 

0.02 

0.00 

0.00 

BMW 

14 

2NBT31 

A 

1 

70 

85 

1.65 

0.11 

0.84 

0.44 

BMW 

14 

2NBT31 

B 

0 

6 

7 

0.14 

0.44 

0.62 

-0.36 

BMW 

14 

2NBT31 

C 

0 

6 

7 

0.62 

0.37 

0.87 

-0.23 

BMW 

14 

2NBT31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

15 

2NBT813 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

BMW 

15 

2NBT813 

A 

1 

65 

77 

1.90 

0.13 

0.86 

0.51 

BMW 

15 

2NBT813 

B 

0 

10 

12 

0.78 

0.17 

0.69 

-0.25 

BMW 

15 

2NBT813 

C 

0 

9 

11 

0.17 

0.24 

0.42 

-0.42 

BMW 

15 

2NBT813 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMW  = Benchmark  Winter. 


easyCBM  CCSS  Second  Grade  Math  Measure  Development 


146 

Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

16 

21883 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

BMW 

16 

21883 

A 

1 

27 

60 

1.91 

0.26 

1.04 

0.50 

BMW 

16 

21883 

B 

0 

6 

13 

0.67 

0.57 

1.13 

-0.17 

BMW 

16 

21883 

C 

0 

7 

16 

0.26 

0.28 

0.53 

-0.30 

BMW 

16 

21883 

D 

0 

5 

11 

0.24 

0.84 

1.14 

-0.25 

BMW 

17 

21812 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

BMW 

17 

21812 

A 

1 

20 

44 

2.63 

0.36 

0.99 

0.65 

BMW 

17 

21812 

B 

0 

19 

42 

0.80 

0.16 

0.77 

-0.32 

BMW 

17 

21812 

C 

0 

3 

7 

0.20 

0.18 

0.35 

-0.20 

BMW 

17 

21812 

D 

0 

3 

7 

-1.41 

0.60 

0.10 

-0.46 

BMW 

18 

2OA210 

* 

-1 

3902 

98 

1.51 

0.02 

0.00 

-0.03 

BMW 

18 

2OA210 

A 

1 

79 

88 

1.90 

0.13 

1.05 

0.27 

BMW 

18 

2OA210 

B 

0 

6 

7 

0.49 

0.31 

0.55 

-0.29 

BMW 

18 

2OA210 

C 

0 

5 

6 

1.41 

0.30 

1.36 

-0.07 

BMW 

18 

2OA210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

19 

20A431 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

BMW 

19 

20A431 

A 

1 

54 

78 

1.74 

0.19 

0.91 

0.46 

BMW 

19 

20A431 

B 

0 

8 

12 

0.03 

0.20 

0.50 

-0.34 

BMW 

19 

20A431 

C 

0 

7 

10 

0.19 

0.28 

0.64 

-0.28 

BMW 

19 

20A431 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

20 

22075 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

BMW 

20 

22075 

A 

1 

33 

73 

1.70 

0.25 

1.13 

0.46 

BMW 

20 

22075 

B 

0 

5 

11 

0.10 

0.34 

0.59 

-0.30 

BMW 

20 

22075 

C 

0 

1 

2 

0.26 

0.00 

0.54 

-0.11 

BMW 

20 

22075 

D 

0 

6 

13 

0.30 

0.39 

0.86 

-0.28 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

21 

22351 

* 

-1 

3794 

95 

1.52 

0.02 

0.00 

0.00 

BMW 

21 

22351 

A 

1 

150 

76 

1.73 

0.10 

1.09 

0.35 

BMW 

21 

22351 

B 

0 

21 

11 

0.98 

0.15 

1.04 

-0.14 

BMW 

21 

22351 

C 

0 

19 

10 

1.04 

0.19 

1.23 

-0.12 

BMW 

21 

22351 

D 

0 

8 

4 

-0.69 

0.52 

0.26 

-0.36 

BMW 

22 

22112 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

BMW 

22 

22112 

A 

1 

31 

69 

1.92 

0.27 

0.85 

0.51 

BMW 

22 

22112 

B 

0 

6 

13 

0.40 

0.40 

0.86 

-0.22 

BMW 

22 

22112 

C 

0 

1 

2 

-0.80 

0.00 

0.19 

-0.19 

BMW 

22 

22112 

D 

0 

7 

16 

-0.12 

0.65 

0.93 

-0.37 

BMW 

23 

22215 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

BMW 

23 

22215 

A 

1 

29 

67 

1.97 

0.27 

0.85 

0.48 

BMW 

23 

22215 

B 

0 

6 

14 

0.28 

0.36 

0.70 

-0.30 

BMW 

23 

22215 

C 

0 

1 

2 

-0.03 

0.00 

0.37 

-0.14 

BMW 

23 

22215 

D 

0 

7 

16 

0.44 

0.68 

1.89 

-0.28 

BMW 

24 

22327 

* 

-1 

3794 

95 

1.51 

0.02 

0.00 

-0.01 

BMW 

24 

22327 

A 

1 

134 

68 

2.02 

0.10 

0.89 

0.47 

BMW 

24 

22327 

B 

0 

30 

15 

0.87 

0.18 

1.04 

-0.23 

BMW 

24 

22327 

C 

0 

28 

14 

0.74 

0.20 

0.91 

-0.27 

BMW 

24 

22327 

D 

0 

6 

3 

-0.35 

0.79 

0.39 

-0.27 

BMW 

25 

22181 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

BMW 

25 

22181 

A 

1 

22 

49 

2.20 

0.29 

0.96 

0.47 

BMW 

25 

22181 

B 

0 

5 

11 

0.33 

0.41 

0.47 

-0.31 

BMW 

25 

22181 

C 

0 

14 

31 

1.03 

0.34 

1.17 

-0.24 

BMW 

25 

22181 

D 

0 

4 

9 

1.14 

0.41 

0.95 

-0.09 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

26 

3NF26 

* 

-1 

4871 

98 

1.18 

0.02 

0.00 

-0.12 

BMW 

26 

3NF26 

A 

1 

116 

94 

2.30 

0.10 

0.95 

0.33 

BMW 

26 

3NF26 

B 

0 

5 

4 

0.94 

0.41 

0.68 

-0.23 

BMW 

26 

3NF26 

C 

0 

2 

2 

0.15 

0.14 

0.21 

-0.24 

BMW 

26 

3NF26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

27 

3G17 

* 

-1 

4886 

98 

1.18 

0.02 

0.00 

-0.11 

BMW 

27 

3G17 

A 

1 

97 

90 

2.35 

0.15 

1.07 

0.26 

BMW 

27 

3G17 

B 

0 

9 

8 

1.12 

0.35 

1.15 

-0.22 

BMW 

27 

3G17 

C 

0 

2 

2 

0.84 

1.77 

1.71 

-0.13 

BMW 

27 

3G17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

28 

3NBT229 

* 

-1 

4883 

98 

1.18 

0.02 

0.00 

-0.12 

BMW 

28 

3NBT229 

A 

1 

93 

84 

2.53 

0.12 

0.92 

0.41 

BMW 

28 

3NBT229 

B 

0 

11 

10 

1.21 

0.25 

0.72 

-0.30 

BMW 

28 

3NBT229 

C 

0 

7 

6 

1.06 

0.42 

0.76 

-0.26 

BMW 

28 

3NBT229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

29 

3MD87 

* 

-1 

4887 

98 

1.18 

0.02 

0.00 

-0.11 

BMW 

29 

3MD87 

A 

1 

78 

73 

2.60 

0.17 

1.16 

0.41 

BMW 

29 

3MD87 

B 

0 

14 

13 

1.31 

0.29 

1.13 

-0.24 

BMW 

29 

3MD87 

C 

0 

15 

14 

1.10 

0.30 

0.87 

-0.30 

BMW 

29 

3MD87 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

30 

3NF265 

* 

-1 

4874 

98 

1.19 

0.02 

0.00 

-0.09 

BMW 

30 

3NF265 

A 

1 

71 

59 

2.41 

0.15 

0.97 

0.44 

BMW 

30 

3NF265 

B 

0 

32 

27 

1.49 

0.16 

1.15 

-0.24 

BMW 

30 

3NF265 

C 

0 

17 

14 

1.03 

0.14 

0.55 

-0.31 

BMW 

30 

3NF265 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMW 

31 

10003 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

BMW 

31 

10003 

A 

1 

20 

83 

1.27 

0.31 

0.88 

0.51 

BMW 

31 

10003 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

31 

10003 

C 

0 

3 

13 

-0.66 

0.74 

0.58 

-0.40 

BMW 

31 

10003 

D 

0 

1 

4 

-1.22 

0.00 

0.22 

-0.30 

BMW 

32 

1MD111 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.04 

BMW 

32 

1MD111 

A 

1 

65 

90 

1.88 

0.11 

0.94 

0.28 

BMW 

32 

1MD111 

B 

0 

3 

4 

0.86 

0.25 

0.56 

-0.21 

BMW 

32 

1MD111 

C 

0 

4 

6 

1.10 

0.60 

1.19 

-0.18 

BMW 

32 

1MD111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

33 

10A413 

* 

-1 

1748 

92 

1.52 

0.03 

0.00 

-0.02 

BMW 

33 

10A413 

A 

1 

118 

81 

1.87 

0.10 

1.16 

0.44 

BMW 

33 

10A413 

B 

0 

12 

8 

0.31 

0.21 

0.50 

-0.33 

BMW 

33 

10A413 

C 

0 

16 

11 

0.70 

0.20 

0.81 

-0.27 

BMW 

33 

10A413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

34 

1NBT522 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

BMW 

34 

1NBT522 

A 

1 

47 

55 

2.04 

0.16 

0.83 

0.52 

BMW 

34 

1NBT522 

B 

0 

8 

9 

0.45 

0.25 

0.51 

-0.28 

BMW 

34 

1NBT522 

C 

0 

31 

36 

0.87 

0.18 

1.22 

-0.38 

BMW 

34 

1NBT522 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

35 

1MD217 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

BMW 

35 

1MD217 

A 

1 

53 

56 

2.19 

0.15 

1.02 

0.34 

BMW 

35 

1MD217 

B 

0 

18 

19 

1.43 

0.19 

0.94 

-0.19 

BMW 

35 

1MD217 

C 

0 

24 

25 

1.46 

0.22 

1.27 

-0.21 

BMW 

35 

1MD217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMW  = Benchmark  Winter. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

1 

2G36 

* 

-1 

3920 

98 

1.52 

0.02 

0.00 

0.01 

BMS 

1 

2G36 

A 

1 

67 

93 

1.50 

0.14 

1.01 

0.19 

BMS 

1 

2G36 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

1 

2G36 

C 

0 

5 

7 

0.64 

0.54 

1.26 

-0.19 

BMS 

1 

2G36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

2 

2G327 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

BMS 

2 

2G327 

A 

1 

62 

91 

2.20 

0.17 

0.85 

0.34 

BMS 

2 

2G327 

B 

0 

1 

1 

-0.19 

0.00 

0.22 

-0.19 

BMS 

2 

2G327 

C 

0 

5 

7 

0.62 

0.81 

1.46 

-0.28 

BMS 

2 

2G327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

3 

2G320 

* 

-1 

3920 

98 

1.52 

0.02 

0.00 

0.01 

BMS 

3 

2G320 

A 

1 

47 

65 

1.67 

0.23 

1.30 

0.29 

BMS 

3 

2G320 

B 

0 

18 

25 

0.98 

0.20 

1.42 

-0.15 

BMS 

3 

2G320 

C 

0 

7 

10 

0.26 

0.36 

0.73 

-0.25 

BMS 

3 

2G320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

4 

23340 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

BMS 

4 

23340 

A 

1 

38 

84 

1.62 

0.24 

0.89 

0.38 

BMS 

4 

23340 

B 

0 

2 

4 

1.94 

0.17 

3.47 

0.08 

BMS 

4 

23340 

C 

0 

3 

7 

-0.82 

0.29 

0.23 

-0.38 

BMS 

4 

23340 

D 

0 

2 

4 

-0.68 

0.97 

0.38 

-0.29 

BMS 

5 

23333 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

BMS 

5 

23333 

A 

1 

35 

78 

1.64 

0.24 

0.89 

0.51 

BMS 

5 

23333 

B 

0 

3 

7 

-0.34 

0.93 

0.83 

-0.28 

BMS 

5 

23333 

C 

0 

4 

9 

-0.11 

0.48 

0.64 

-0.28 

BMS 

5 

23333 

D 

0 

3 

7 

-0.27 

0.36 

0.45 

-0.26 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

6 

23110 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

BMS 

6 

23110 

A 

1 

38 

83 

1.75 

0.17 

0.82 

0.49 

BMS 

6 

23110 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

6 

23110 

C 

0 

5 

11 

0.64 

0.50 

0.98 

-0.24 

BMS 

6 

23110 

D 

0 

3 

7 

-0.59 

0.71 

0.33 

-0.45 

BMS 

7 

23186 

* 

-1 

3945 

99 

1.52 

0.02 

0.00 

0.02 

BMS 

7 

23186 

A 

1 

35 

74 

1.52 

0.19 

0.93 

0.40 

BMS 

7 

23186 

B 

0 

1 

2 

-0.39 

0.00 

0.28 

-0.19 

BMS 

7 

23186 

C 

0 

11 

23 

0.44 

0.38 

1.45 

-0.35 

BMS 

7 

23186 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

8 

2MD1014 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.02 

BMS 

8 

2MD1014 

A 

1 

59 

74 

1.48 

0.11 

1.03 

0.37 

BMS 

8 

2MD1014 

B 

0 

5 

6 

0.51 

0.47 

0.81 

-0.23 

BMS 

8 

2MD1014 

C 

0 

16 

20 

0.84 

0.15 

0.88 

-0.26 

BMS 

8 

2MD1014 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

9 

2MD52 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

BMS 

9 

2MD52 

A 

1 

45 

59 

1.92 

0.17 

0.95 

0.51 

BMS 

9 

2MD52 

B 

0 

24 

32 

0.70 

0.13 

0.68 

-0.43 

BMS 

9 

2MD52 

C 

0 

7 

9 

0.76 

0.45 

1.27 

-0.18 

BMS 

9 

2MD52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

10 

23308 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

BMS 

10 

23308 

A 

1 

22 

50 

2.11 

0.33 

1.36 

0.41 

BMS 

10 

23308 

B 

0 

6 

14 

1.57 

0.60 

3.42 

0.02 

BMS 

10 

23308 

C 

0 

14 

32 

0.79 

0.25 

0.79 

-0.33 

BMS 

10 

23308 

D 

0 

2 

5 

-0.38 

1.04 

0.28 

-0.28 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

11 

21529 

* 

-1 

3795 

95 

1.50 

0.02 

0.00 

-0.04 

BMS 

11 

21529 

A 

1 

180 

91 

1.92 

0.10 

0.95 

0.35 

BMS 

11 

21529 

B 

0 

7 

4 

0.16 

0.40 

0.63 

-0.21 

BMS 

11 

21529 

C 

0 

8 

4 

0.04 

0.29 

0.52 

-0.24 

BMS 

11 

21529 

D 

0 

2 

1 

0.02 

1.08 

0.62 

-0.12 

BMS 

12 

2NBT814 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

BMS 

12 

2NBT814 

A 

1 

62 

90 

1.66 

0.13 

1.00 

0.27 

BMS 

12 

2NBT814 

B 

0 

4 

6 

0.96 

0.32 

0.92 

-0.14 

BMS 

12 

2NBT814 

C 

0 

3 

4 

0.43 

0.13 

0.48 

-0.23 

BMS 

12 

2NBT814 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

13 

21549 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

BMS 

13 

21549 

A 

1 

38 

84 

1.82 

0.24 

0.85 

0.41 

BMS 

13 

21549 

B 

0 

3 

7 

-0.27 

0.77 

0.52 

-0.31 

BMS 

13 

21549 

C 

0 

3 

7 

0.78 

0.62 

1.36 

-0.13 

BMS 

13 

21549 

D 

0 

1 

2 

-1.07 

0.00 

0.15 

-0.25 

BMS 

14 

2NBT31 

* 

-1 

3910 

98 

1.52 

0.02 

0.00 

0.00 

BMS 

14 

2NBT31 

A 

1 

70 

85 

1.65 

0.11 

0.84 

0.44 

BMS 

14 

2NBT31 

B 

0 

6 

7 

0.14 

0.44 

0.62 

-0.36 

BMS 

14 

2NBT31 

C 

0 

6 

7 

0.62 

0.37 

0.87 

-0.23 

BMS 

14 

2NBT31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

15 

2NBT810 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

BMS 

15 

2NBT810 

A 

1 

57 

75 

1.78 

0.14 

0.82 

0.53 

BMS 

15 

2NBT810 

B 

0 

15 

20 

0.33 

0.17 

0.55 

-0.47 

BMS 

15 

2NBT810 

C 

0 

4 

5 

0.51 

0.46 

0.71 

-0.19 

BMS 

15 

2NBT810 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

16 

2NBT33 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

BMS 

16 

2NBT33 

A 

1 

50 

76 

2.60 

0.17 

0.93 

0.44 

BMS 

16 

2NBT33 

B 

0 

4 

6 

0.49 

0.50 

0.39 

-0.34 

BMS 

16 

2NBT33 

C 

0 

12 

18 

1.49 

0.34 

1.22 

-0.28 

BMS 

16 

2NBT33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

17 

21886 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

BMS 

17 

21886 

A 

1 

19 

42 

2.11 

0.27 

1.01 

0.53 

BMS 

17 

21886 

B 

0 

5 

11 

0.21 

0.53 

0.48 

-0.24 

BMS 

17 

21886 

C 

0 

18 

40 

0.85 

0.17 

0.74 

-0.20 

BMS 

17 

21886 

D 

0 

3 

7 

-0.70 

1.94 

0.99 

-0.35 

BMS 

18 

22189 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

BMS 

18 

22189 

A 

1 

37 

82 

1.69 

0.23 

0.97 

0.39 

BMS 

18 

22189 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

18 

22189 

C 

0 

3 

7 

0.60 

0.80 

1.41 

-0.15 

BMS 

18 

22189 

D 

0 

5 

11 

-0.10 

0.71 

0.90 

-0.36 

BMS 

19 

22070 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.01 

BMS 

19 

22070 

A 

1 

35 

81 

1.86 

0.25 

1.03 

0.33 

BMS 

19 

22070 

B 

0 

2 

5 

0.48 

0.01 

0.58 

-0.17 

BMS 

19 

22070 

C 

0 

3 

7 

1.39 

0.70 

2.41 

-0.04 

BMS 

19 

22070 

D 

0 

3 

7 

-0.06 

0.32 

0.38 

-0.31 

BMS 

20 

20A321 

* 

-1 

3917 

98 

1.52 

0.02 

0.00 

0.01 

BMS 

20 

20A321 

A 

1 

58 

77 

1.66 

0.15 

1.03 

0.36 

BMS 

20 

20A321 

B 

0 

8 

11 

0.25 

0.23 

0.50 

-0.35 

BMS 

20 

20A321 

C 

0 

9 

12 

1.03 

0.21 

1.07 

-0.13 

BMS 

20 

20A321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

21 

22229 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

BMS 

21 

22229 

A 

1 

31 

69 

1.75 

0.26 

0.89 

0.49 

BMS 

21 

22229 

B 

0 

3 

7 

0.75 

0.62 

1.41 

-0.07 

BMS 

21 

22229 

C 

0 

3 

7 

0.87 

0.96 

2.66 

-0.05 

BMS 

21 

22229 

D 

0 

8 

18 

-0.69 

0.61 

0.62 

-0.52 

BMS 

22 

22112 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

BMS 

22 

22112 

A 

1 

31 

69 

1.92 

0.27 

0.85 

0.51 

BMS 

22 

22112 

B 

0 

6 

13 

0.40 

0.40 

0.86 

-0.22 

BMS 

22 

22112 

C 

0 

1 

2 

-0.80 

0.00 

0.19 

-0.19 

BMS 

22 

22112 

D 

0 

7 

16 

-0.12 

0.65 

0.93 

-0.37 

BMS 

23 

22110 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.01 

BMS 

23 

22110 

A 

1 

30 

70 

2.34 

0.29 

0.82 

0.56 

BMS 

23 

22110 

B 

0 

5 

12 

-0.45 

0.30 

0.28 

-0.44 

BMS 

23 

22110 

C 

0 

7 

16 

0.84 

0.51 

2.41 

-0.21 

BMS 

23 

22110 

D 

0 

1 

2 

-1.01 

0.00 

0.13 

-0.24 

BMS 

24 

22308 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

BMS 

24 

22308 

A 

1 

26 

57 

1.84 

0.32 

1.28 

0.54 

BMS 

24 

22308 

B 

0 

7 

15 

0.51 

0.33 

1.01 

-0.14 

BMS 

24 

22308 

C 

0 

6 

13 

0.13 

0.43 

0.80 

-0.22 

BMS 

24 

22308 

D 

0 

7 

15 

-0.46 

0.45 

0.48 

-0.39 

BMS 

25 

22316 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

BMS 

25 

22316 

A 

1 

24 

53 

2.68 

0.32 

1.09 

0.57 

BMS 

25 

22316 

B 

0 

11 

24 

1.17 

0.34 

1.30 

-0.24 

BMS 

25 

22316 

C 

0 

4 

9 

0.26 

0.35 

0.36 

-0.31 

BMS 

25 

22316 

D 

0 

6 

13 

0.76 

0.34 

0.65 

-0.27 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

26 

3NF28 

* 

-1 

4883 

98 

1.19 

0.02 

0.00 

-0.10 

BMS 

26 

3NF28 

A 

1 

103 

93 

2.21 

0.13 

0.96 

0.31 

BMS 

26 

3NF28 

B 

0 

7 

6 

0.82 

0.30 

0.67 

-0.25 

BMS 

26 

3NF28 

C 

0 

1 

1 

-0.65 

0.00 

0.12 

-0.20 

BMS 

26 

3NF28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

27 

3G211 

* 

-1 

4886 

98 

1.18 

0.02 

0.00 

-0.11 

BMS 

27 

3G211 

A 

1 

97 

90 

2.42 

0.14 

0.93 

0.40 

BMS 

27 

3G211 

B 

0 

7 

6 

0.51 

0.45 

0.93 

-0.30 

BMS 

27 

3G211 

C 

0 

4 

4 

0.28 

0.47 

0.45 

-0.25 

BMS 

27 

3G211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

28 

3NBT321 

* 

-1 

4888 

98 

1.19 

0.02 

0.00 

-0.07 

BMS 

28 

3NBT321 

A 

1 

83 

78 

2.04 

0.11 

1.13 

0.44 

BMS 

28 

3NBT321 

B 

0 

20 

19 

0.89 

0.15 

0.64 

-0.42 

BMS 

28 

3NBT321 

C 

0 

3 

3 

1.13 

0.10 

0.67 

-0.11 

BMS 

28 

3NBT321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

29 

3MD25 

* 

-1 

4867 

97 

1.19 

0.02 

0.00 

-0.08 

BMS 

29 

3MD25 

A 

1 

88 

69 

2.40 

0.12 

0.82 

0.60 

BMS 

29 

3MD25 

B 

0 

23 

18 

0.80 

0.17 

0.58 

-0.42 

BMS 

29 

3MD25 

C 

0 

16 

13 

0.77 

0.20 

0.58 

-0.35 

BMS 

29 

3MD25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

30 

3NF280 

* 

-1 

4878 

98 

1.19 

0.02 

0.00 

-0.08 

BMS 

30 

3NF280 

A 

1 

70 

60 

2.33 

0.13 

0.97 

0.44 

BMS 

30 

3NF280 

B 

0 

22 

19 

1.35 

0.13 

0.78 

-0.27 

BMS 

30 

3NF280 

C 

0 

24 

21 

1.36 

0.18 

0.91 

-0.28 

BMS 

30 

3NF280 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMS  = Benchmark  Spring. 
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Appendix  C:  Distractor  by  Test  Form 


Form 

Item  Number 

ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

BMS 

31 

10211 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.04 

BMS 

31 

10211 

A 

1 

18 

86 

1.08 

0.30 

1.27 

0.28 

BMS 

31 

10211 

B 

0 

3 

14 

0.09 

0.39 

0.77 

-0.28 

BMS 

31 

10211 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

31 

10211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

32 

1MD215 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

BMS 

32 

1MD215 

A 

1 

63 

89 

2.05 

0.14 

0.82 

0.50 

BMS 

32 

1MD215 

B 

0 

3 

4 

0.20 

0.52 

0.41 

-0.29 

BMS 

32 

1MD215 

C 

0 

5 

7 

0.13 

0.21 

0.32 

-0.39 

BMS 

32 

1MD215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

33 

10062 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

BMS 

33 

10062 

A 

1 

17 

71 

1.81 

0.46 

1.07 

0.47 

BMS 

33 

10062 

B 

0 

1 

4 

-0.95 

0.00 

0.23 

-0.26 

BMS 

33 

10062 

C 

0 

6 

25 

0.13 

0.18 

0.75 

-0.37 

BMS 

33 

10062 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

34 

1NBT57 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.04 

BMS 

34 

1NBT57 

A 

1 

43 

61 

2.16 

0.19 

1.28 

0.37 

BMS 

34 

1NBT57 

B 

0 

11 

16 

1.17 

0.33 

1.15 

-0.24 

BMS 

34 

1NBT57 

C 

0 

16 

23 

1.32 

0.20 

1.02 

-0.23 

BMS 

34 

1NBT57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

35 

1MD121 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

BMS 

35 

1MD121 

A 

1 

39 

54 

2.16 

0.18 

1.38 

0.22 

BMS 

35 

1MD121 

B 

0 

3 

4 

0.94 

0.38 

0.43 

-0.19 

BMS 

35 

1MD121 

C 

0 

30 

42 

1.76 

0.19 

1.38 

-0.14 

BMS 

35 

1MD121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

Note.  BMS  = Benchmark  Spring. 
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Appendix  D:  Item  Statistics 


Appendix  D:  Item  Statistics  for  Full  CCSS  Item  Bank 
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Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21501 

-0.94 

44 

39 

0.52 

0.64 

-1.08 

0.33 

-1.15 

0.00 

0.61 

1.29 

21502 

-0.65 

45 

37 

0.45 

0.62 

-1.60 

0.51 

-1.08 

0.00 

0.61 

1.38 

21503 

-1.25 

46 

41 

0.51 

0.85 

-0.40 

0.45 

-0.41 

0.00 

0.41 

1.18 

21504 

-1.16 

44 

38 

0.52 

0.75 

-0.64 

0.45 

-0.64 

0.00 

0.62 

1.20 

21505 

-1.28 

45 

40 

0.57 

1.25 

0.72 

1.67 

0.92 

0.00 

0.36 

0.80 

21506 

-1.17 

46 

40 

0.50 

0.83 

-0.48 

0.84 

0.00 

0.00 

0.46 

1.12 

21507 

-1.31 

44 

39 

0.52 

1.04 

0.22 

0.95 

0.24 

0.00 

0.32 

0.96 

21508 

-1.01 

46 

38 

0.46 

0.84 

-0.51 

0.63 

-0.43 

0.00 

0.54 

1.16 

21509 

-0.57 

45 

38 

0.45 

0.85 

-0.53 

0.79 

-0.26 

0.00 

0.43 

1.15 

21510 

-0.76 

45 

35 

0.41 

0.87 

-0.55 

0.71 

-0.63 

0.00 

0.51 

1.19 

21511 

-0.54 

45 

36 

0.42 

1.04 

0.25 

1.30 

0.79 

0.00 

0.37 

0.89 

21512 

-0.45 

43 

34 

0.44 

0.95 

-0.09 

1.61 

1.30 

0.00 

0.47 

0.94 

21513 

-1.28 

45 

38 

0.49 

0.99 

0.06 

0.89 

0.10 

0.00 

0.47 

1.00 

21514 

-0.35 

45 

37 

0.43 

0.99 

0.05 

0.87 

-0.17 

0.00 

0.38 

1.03 

21515 

-0.98 

46 

40 

0.50 

1.10 

0.42 

1.48 

0.82 

0.00 

0.33 

0.85 

21516 

-1.36 

45 

41 

0.56 

0.79 

-0.42 

0.41 

-0.57 

0.00 

0.41 

1.18 

21517 

0.72 

45 

27 

0.35 

1.05 

0.39 

1.08 

0.39 

0.00 

0.45 

0.88 

21518 

0.21 

43 

28 

0.38 

1.03 

0.23 

0.90 

-0.17 

0.00 

0.53 

0.99 

21519 

-1.07 

44 

38 

0.52 

0.89 

-0.24 

0.48 

-0.50 

0.00 

0.53 

1.15 

21520 

-0.42 

45 

36 

0.42 

0.88 

-0.45 

0.76 

-0.39 

0.00 

0.49 

1.14 

21521 

-1.00 

46 

39 

0.47 

0.81 

-0.64 

1.08 

0.33 

0.00 

0.49 

1.11 

21522 

-0.97 

180 

163 

0.28 

0.97 

-0.13 

0.96 

0.05 

0.00 

0.34 

1.03 

21523 

-1.05 

45 

40 

0.51 

0.85 

-0.36 

0.53 

-0.50 

0.00 

0.43 

1.15 

21524 

-0.86 

45 

38 

0.50 

1.03 

0.20 

0.69 

-0.20 

0.00 

0.53 

1.02 

21525 

-0.64 

45 

37 

0.42 

0.70 

-1.38 

0.47 

-0.98 

0.00 

0.52 

1.39 

21526 

-0.18 

44 

30 

0.38 

0.69 

-1.74 

0.55 

-1.50 

0.00 

0.71 

1.46 

21527 

-0.07 

46 

33 

0.37 

1.15 

0.90 

1.47 

1.47 

0.00 

0.28 

0.62 
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Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21528 

-0.35 

45 

36 

0.43 

1.04 

0.24 

1.39 

0.91 

0.00 

0.37 

0.87 

21529 

-1.32 

197 

180 

0.27 

0.94 

-0.24 

0.61 

-0.83 

0.00 

0.35 

1.07 

21530 

-0.80 

45 

36 

0.43 

0.99 

0.02 

1.08 

0.32 

0.00 

0.46 

0.99 

21531 

-0.53 

46 

36 

0.43 

0.90 

-0.36 

1.39 

0.79 

0.00 

0.53 

1.04 

21532 

-0.71 

45 

37 

0.44 

0.72 

-1.25 

0.47 

-0.99 

0.00 

0.58 

1.35 

21533 

-1.97 

45 

43 

0.75 

0.98 

0.16 

0.50 

-0.22 

0.00 

0.23 

1.05 

21534 

-0.95 

46 

40 

0.50 

0.68 

-1.01 

0.34 

-1.07 

0.00 

0.61 

1.29 

21535 

0.02 

45 

34 

0.40 

1.03 

0.22 

1.10 

0.36 

0.00 

0.45 

0.93 

21536 

-1.19 

45 

40 

0.50 

0.80 

-0.53 

0.47 

-0.92 

0.00 

0.47 

1.19 

21537 

-0.27 

46 

36 

0.41 

1.08 

0.44 

1.47 

1.15 

0.00 

0.37 

0.82 

21538 

-0.31 

45 

35 

0.40 

1.04 

0.28 

1.40 

0.96 

0.00 

0.34 

0.86 

21539 

-0.61 

44 

35 

0.47 

0.59 

-1.71 

0.36 

-1.21 

0.00 

0.69 

1.43 

21540 

-1.52 

45 

41 

0.60 

1.08 

0.33 

0.57 

-0.19 

0.00 

0.41 

1.01 

21541 

-0.44 

45 

35 

0.43 

0.67 

-1.59 

0.41 

-1.24 

0.00 

0.66 

1.43 

21542 

-1.41 

45 

41 

0.59 

1.17 

0.53 

3.32 

1.91 

0.00 

0.24 

0.79 

21543 

0.10 

45 

32 

0.39 

0.86 

-0.69 

0.76 

-0.41 

0.00 

0.58 

1.21 

21544 

-0.51 

45 

37 

0.43 

1.07 

0.38 

1.12 

0.40 

0.00 

0.29 

0.89 

21545 

-1.19 

45 

40 

0.52 

0.91 

-0.19 

0.64 

-0.19 

0.00 

0.40 

1.11 

21546 

-1.07 

45 

40 

0.51 

1.13 

0.50 

1.66 

0.95 

0.00 

0.17 

0.82 

21547 

-1.97 

45 

41 

0.66 

1.24 

0.64 

1.69 

0.89 

0.00 

0.36 

0.83 

21548 

-1.15 

45 

39 

0.50 

0.81 

-0.51 

0.56 

-0.59 

0.00 

0.54 

1.17 

21549 

-0.76 

45 

38 

0.45 

0.89 

-0.33 

0.83 

-0.06 

0.00 

0.41 

1.09 

21550 

-0.93 

41 

35 

0.51 

0.73 

-0.85 

0.44 

-0.75 

0.00 

0.55 

1.27 

21551 

-0.22 

44 

35 

0.42 

0.71 

-1.43 

0.52 

-1.12 

0.00 

0.59 

1.40 

21552 

-1.07 

46 

40 

0.46 

1.13 

0.52 

1.00 

0.20 

0.00 

0.19 

0.90 

21553 

0.27 

45 

30 

0.36 

1.10 

0.68 

1.13 

0.52 

0.00 

0.37 

0.76 

21554 

-1.20 

45 

41 

0.55 

0.86 

-0.24 

0.57 

-0.39 

0.00 

0.32 

1.12 
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Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21555 

-0.75 

45 

39 

0.51 

0.54 

-1.60 

0.32 

-0.99 

0.00 

0.63 

1.38 

21556 

-1.17 

44 

39 

0.50 

1.09 

0.38 

1.14 

0.42 

0.00 

0.19 

0.90 

21557 

-1.60 

45 

41 

0.56 

0.95 

-0.01 

0.92 

0.19 

0.00 

0.31 

1.03 

21558 

-0.34 

45 

38 

0.45 

0.91 

-0.26 

1.07 

0.31 

0.00 

0.39 

1.05 

21559 

0.23 

43 

31 

0.41 

1.06 

0.34 

1.18 

0.50 

0.00 

0.48 

0.90 

21560 

-1.21 

206 

186 

0.25 

0.96 

-0.17 

0.66 

-0.93 

0.00 

0.35 

1.06 

21561 

-0.70 

46 

37 

0.41 

1.02 

0.16 

0.86 

-0.14 

0.00 

0.39 

1.01 

21562 

-0.02 

45 

34 

0.41 

0.69 

-1.56 

0.58 

-0.76 

0.00 

0.63 

1.40 

21563 

0.26 

44 

33 

0.40 

0.83 

-0.80 

0.68 

-0.66 

0.00 

0.57 

1.25 

21564 

-0.70 

44 

38 

0.47 

0.89 

-0.31 

0.70 

-0.26 

0.00 

0.39 

1.11 

21565 

-1.12 

46 

39 

0.47 

0.66 

-1.31 

0.37 

-1.18 

0.00 

0.60 

1.34 

21566 

-0.23 

45 

34 

0.39 

0.82 

-0.97 

0.72 

-0.67 

0.00 

0.50 

1.29 

21567 

-0.87 

44 

37 

0.53 

0.62 

-1.16 

0.32 

-0.93 

0.00 

0.69 

1.31 

21568 

-1.31 

44 

39 

0.51 

0.87 

-0.30 

0.59 

-0.26 

0.00 

0.39 

1.14 

21569 

-0.61 

44 

37 

0.45 

0.92 

-0.23 

0.60 

-0.55 

0.00 

0.43 

1.14 

21570 

-1.50 

184 

172 

0.32 

0.89 

-0.43 

1.14 

0.43 

0.00 

0.32 

1.04 

21571 

0.04 

44 

32 

0.40 

0.96 

-0.15 

0.90 

-0.03 

0.00 

0.52 

1.05 

21572 

-0.50 

44 

35 

0.42 

0.74 

-1.16 

0.48 

-1.19 

0.00 

0.60 

1.34 

21573 

-0.75 

46 

39 

0.45 

0.97 

-0.01 

0.83 

-0.14 

0.00 

0.37 

1.04 

21574 

-1.10 

44 

38 

0.48 

0.97 

-0.01 

0.65 

-0.22 

0.00 

0.38 

1.07 

21575 

0.10 

44 

33 

0.42 

0.72 

-1.30 

0.50 

-1.23 

0.00 

0.69 

1.36 

21576 

-0.96 

43 

35 

0.48 

0.81 

-0.63 

0.43 

-0.84 

0.00 

0.65 

1.24 

21577 

-1.26 

45 

39 

0.48 

0.72 

-1.01 

0.39 

-0.73 

0.00 

0.49 

1.31 

21578 

-1.91 

45 

42 

0.63 

0.88 

-0.11 

0.70 

0.04 

0.00 

0.33 

1.07 

21579 

-0.66 

45 

35 

0.41 

1.03 

0.19 

0.89 

-0.16 

0.00 

0.44 

1.00 

21580 

-1.10 

46 

40 

0.48 

1.06 

0.31 

0.91 

0.08 

0.00 

0.33 

0.95 

21581 

-1.45 

46 

40 

0.47 

0.88 

-0.35 

0.65 

-0.29 

0.00 

0.40 

1.13 
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Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21582 

-0.18 

44 

33 

0.38 

0.90 

-0.54 

0.76 

-0.56 

0.00 

0.46 

1.19 

21583 

0.21 

45 

32 

0.39 

1.07 

0.41 

0.98 

0.07 

0.00 

0.47 

0.92 

21584 

-1.70 

45 

42 

0.63 

0.87 

-0.13 

0.46 

-0.48 

0.00 

0.35 

1.11 

21585 

-0.43 

44 

35 

0.41 

1.14 

0.67 

1.03 

0.22 

0.00 

0.31 

0.84 

21586 

-0.88 

43 

35 

0.44 

0.62 

-1.67 

0.41 

-1.37 

0.00 

0.60 

1.43 

21587 

0.04 

44 

30 

0.38 

0.99 

0.01 

0.87 

-0.22 

0.00 

0.50 

1.04 

21588 

-0.65 

44 

37 

0.46 

0.91 

-0.29 

0.64 

-0.44 

0.00 

0.45 

1.14 

21589 

-2.58 

44 

42 

0.77 

0.68 

-0.41 

0.19 

-0.46 

0.00 

0.46 

1.19 

21590 

-0.68 

44 

37 

0.47 

1.05 

0.27 

1.30 

0.71 

0.00 

0.35 

0.90 

21591 

-0.35 

43 

35 

0.45 

1.09 

0.44 

1.12 

0.40 

0.00 

0.39 

0.89 

21592 

-0.78 

46 

39 

0.45 

0.80 

-0.72 

0.94 

0.11 

0.00 

0.48 

1.16 

21593 

-1.68 

46 

43 

0.62 

0.79 

-0.32 

0.49 

-0.41 

0.00 

0.38 

1.14 

21594 

-0.83 

46 

39 

0.45 

0.87 

-0.40 

0.84 

-0.11 

0.00 

0.42 

1.10 

21595 

-0.39 

45 

35 

0.41 

0.91 

-0.43 

0.97 

0.08 

0.00 

0.48 

1.10 

21596 

-1.65 

45 

42 

0.66 

0.88 

-0.10 

0.30 

-0.44 

0.00 

0.44 

1.14 

21597 

-0.68 

44 

38 

0.48 

0.92 

-0.16 

0.96 

0.15 

0.00 

0.40 

1.03 

21598 

-1.31 

44 

41 

0.62 

1.12 

0.41 

1.07 

0.39 

0.00 

0.15 

0.91 

21599 

-0.38 

46 

37 

0.44 

0.77 

-0.90 

0.49 

-0.95 

0.00 

0.61 

1.28 

21600 

0.02 

144 

114 

0.24 

0.89 

-0.80 

0.74 

-0.99 

0.00 

0.53 

1.14 

21601 

-0.16 

44 

33 

0.41 

1.12 

0.63 

1.01 

0.18 

0.00 

0.44 

0.87 

21602 

0.53 

45 

31 

0.37 

0.77 

-1.34 

0.68 

-1.13 

0.00 

0.61 

1.39 

21603 

0.06 

44 

33 

0.41 

0.76 

-1.24 

0.63 

-0.88 

0.00 

0.63 

1.34 

21604 

-0.22 

46 

38 

0.43 

1.17 

0.76 

1.33 

0.78 

0.00 

0.27 

0.77 

21605 

0.48 

45 

34 

0.37 

0.90 

-0.53 

0.74 

-0.72 

0.00 

0.44 

1.21 

21606 

-0.29 

2539 

1972 

0.05 

0.93 

-2.52 

0.89 

-1.79 

0.00 

0.48 

1.10 

21607 

-1.12 

45 

41 

0.56 

0.99 

0.11 

0.89 

0.17 

0.00 

0.30 

1.01 

21608 

-0.50 

44 

38 

0.49 

0.72 

-0.88 

0.46 

-1.08 

0.00 

0.57 

1.27 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21609 

-1.18 

45 

39 

0.51 

0.64 

-1.18 

0.35 

-1.04 

0.00 

0.63 

1.31 

21610 

-1.27 

45 

40 

0.56 

0.94 

-0.03 

2.11 

1.30 

0.00 

0.43 

0.96 

21611 

-0.61 

45 

37 

0.44 

1.06 

0.30 

0.73 

-0.32 

0.00 

0.41 

1.01 

21612 

0.04 

45 

32 

0.38 

0.83 

-0.87 

1.24 

0.70 

0.00 

0.54 

1.15 

21613 

-0.90 

44 

36 

0.44 

0.70 

-1.24 

0.52 

-0.71 

0.00 

0.53 

1.32 

21614 

-1.41 

45 

39 

0.56 

0.78 

-0.49 

0.69 

-0.06 

0.00 

0.58 

1.13 

21615 

0.19 

44 

30 

0.36 

0.77 

-1.60 

0.65 

-1.47 

0.00 

0.58 

1.52 

21616 

-0.11 

46 

35 

0.40 

0.59 

-2.20 

0.43 

-1.85 

0.00 

0.64 

1.55 

21617 

-0.59 

46 

38 

0.43 

0.75 

-1.05 

0.44 

-1.15 

0.00 

0.56 

1.32 

21618 

-0.85 

45 

38 

0.45 

0.56 

-1.85 

0.33 

-1.60 

0.00 

0.63 

1.44 

21619 

-0.37 

45 

36 

0.45 

0.68 

-1.24 

0.44 

-1.09 

0.00 

0.66 

1.33 

21620 

-0.37 

46 

37 

0.42 

0.92 

-0.31 

0.71 

-0.52 

0.00 

0.45 

1.15 

21621 

-0.91 

45 

38 

0.47 

0.72 

-1.13 

0.90 

0.10 

0.00 

0.51 

1.23 

21622 

-0.89 

249 

219 

0.21 

0.95 

-0.33 

0.68 

-1.25 

0.00 

0.37 

1.07 

21623 

-0.78 

45 

39 

0.47 

1.05 

0.26 

1.25 

0.59 

0.00 

0.25 

0.92 

21624 

-0.68 

46 

37 

0.43 

0.98 

-0.01 

0.89 

-0.04 

0.00 

0.47 

1.02 

21625 

-0.40 

45 

35 

0.43 

0.85 

-0.57 

0.52 

-0.73 

0.00 

0.62 

1.23 

21626 

-0.46 

46 

38 

0.44 

1.03 

0.18 

0.75 

-0.26 

0.00 

0.44 

1.02 

21627 

-0.60 

54 

45 

0.42 

0.81 

-0.75 

0.53 

-0.82 

0.00 

0.56 

1.22 

21628 

-0.75 

44 

38 

0.48 

0.88 

-0.30 

0.61 

-0.50 

0.00 

0.45 

1.13 

21629 

-0.50 

46 

37 

0.41 

0.97 

-0.08 

0.89 

-0.09 

0.00 

0.40 

1.05 

21630 

0.10 

44 

32 

0.39 

0.83 

-0.84 

0.62 

-1.02 

0.00 

0.61 

1.29 

21631 

-0.42 

45 

36 

0.44 

0.76 

-1.01 

0.52 

-0.83 

0.00 

0.60 

1.29 

21632 

-0.27 

45 

33 

0.39 

0.91 

-0.43 

0.63 

-0.80 

0.00 

0.57 

1.20 

21633 

-0.66 

44 

36 

0.44 

0.88 

-0.41 

0.59 

-0.82 

0.00 

0.47 

1.19 

21634 

-0.76 

44 

38 

0.47 

0.80 

-0.66 

0.52 

-0.64 

0.00 

0.43 

1.23 

21635 

-0.04 

45 

34 

0.41 

1.08 

0.44 

0.88 

-0.16 

0.00 

0.48 

0.95 

easyCBM  CCSS  Second  Grade  Math  Measure  Development 


163 

Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21636 

-0.81 

45 

39 

0.49 

0.82 

-0.51 

0.69 

-0.36 

0.00 

0.46 

1.16 

21637 

-1.07 

46 

42 

0.58 

0.96 

0.02 

0.92 

0.22 

0.00 

0.40 

1.03 

21638 

-0.11 

45 

36 

0.42 

1.27 

1.11 

1.16 

0.46 

0.00 

0.29 

0.71 

21639 

-1.38 

46 

41 

0.52 

1.06 

0.29 

0.80 

0.03 

0.00 

0.36 

0.97 

21640 

-1.15 

45 

39 

0.51 

0.67 

-1.05 

0.38 

-0.74 

0.00 

0.55 

1.29 

21641 

-1.28 

45 

40 

0.56 

0.79 

-0.45 

0.58 

-0.24 

0.00 

0.54 

1.14 

21642 

-0.73 

45 

37 

0.44 

0.95 

-0.09 

1.01 

0.19 

0.00 

0.41 

1.01 

21643 

-1.26 

45 

40 

0.52 

1.03 

0.19 

1.57 

0.92 

0.00 

0.31 

0.94 

21644 

-1.21 

46 

39 

0.45 

1.19 

0.77 

0.93 

0.14 

0.00 

0.27 

0.84 

21645 

-1.24 

45 

41 

0.55 

0.97 

0.06 

0.98 

0.21 

0.00 

0.25 

1.00 

21646 

-3.21 

45 

44 

1.04 

1.14 

0.45 

2.30 

1.15 

0.00 

-0.02 

0.86 

21647 

-2.33 

45 

43 

0.75 

0.88 

0.01 

0.70 

0.12 

0.00 

0.27 

1.05 

21648 

-1.32 

44 

38 

0.53 

1.24 

0.73 

1.28 

0.60 

0.00 

0.40 

0.83 

21649 

-1.58 

45 

41 

0.55 

0.80 

-0.42 

0.37 

-0.82 

0.00 

0.46 

1.19 

21650 

-1.66 

45 

40 

0.50 

1.08 

0.34 

1.05 

0.33 

0.00 

0.25 

0.94 

21651 

-1.91 

45 

41 

0.59 

0.94 

-0.05 

1.32 

0.63 

0.00 

0.36 

0.99 

21652 

-2.89 

45 

44 

1.04 

1.13 

0.44 

1.94 

1.00 

0.00 

0.01 

0.87 

21653 

0.08 

46 

30 

0.37 

0.81 

-1.07 

0.70 

-1.06 

0.00 

0.61 

1.34 

21654 

-1.62 

44 

39 

0.50 

0.95 

-0.04 

0.75 

-0.18 

0.00 

0.31 

1.06 

21655 

-0.43 

45 

35 

0.42 

0.70 

-1.44 

0.46 

-1.28 

0.00 

0.64 

1.40 

21656 

-1.38 

45 

40 

0.50 

0.88 

-0.25 

0.57 

-0.50 

0.00 

0.40 

1.12 

21657 

0.11 

45 

35 

0.43 

0.87 

-0.53 

0.86 

-0.16 

0.00 

0.56 

1.13 

21658 

-0.22 

45 

37 

0.43 

1.30 

1.16 

1.27 

0.66 

0.00 

0.19 

0.72 

21659 

-2.85 

45 

43 

0.77 

1.04 

0.26 

1.08 

0.51 

0.00 

0.22 

0.94 

21660 

0.00 

45 

45 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

21661 

-0.68 

43 

37 

0.52 

0.78 

-0.60 

0.41 

-0.77 

0.00 

0.58 

1.23 

21662 

-0.70 

45 

37 

0.44 

1.07 

0.38 

1.06 

0.30 

0.00 

0.36 

0.92 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21663 

-0.72 

45 

34 

0.39 

0.94 

-0.30 

0.69 

-0.44 

0.00 

0.46 

1.17 

21664 

0.00 

45 

35 

0.40 

0.96 

-0.12 

0.76 

-0.41 

0.00 

0.46 

1.10 

21665 

-0.49 

45 

35 

0.41 

0.97 

-0.09 

0.68 

-0.55 

0.00 

0.47 

1.12 

21666 

0.58 

43 

28 

0.36 

1.05 

0.41 

1.26 

0.89 

0.00 

0.37 

0.79 

21667 

-2.40 

45 

43 

0.77 

1.05 

0.28 

0.41 

-0.08 

0.00 

0.29 

1.03 

21668 

0.22 

45 

32 

0.37 

1.21 

1.13 

1.15 

0.55 

0.00 

0.33 

0.70 

21669 

-0.35 

45 

36 

0.42 

0.92 

-0.26 

0.72 

-0.50 

0.00 

0.48 

1.13 

21670 

0.41 

46 

30 

0.35 

0.87 

-0.87 

0.76 

-0.84 

0.00 

0.54 

1.31 

21671 

-0.60 

45 

37 

0.43 

0.76 

-0.95 

0.50 

-1.14 

0.00 

0.56 

1.29 

21672 

-1.03 

46 

40 

0.49 

1.32 

1.08 

1.20 

0.50 

0.00 

0.24 

0.71 

21673 

-0.54 

46 

39 

0.45 

0.80 

-0.68 

0.74 

-0.36 

0.00 

0.51 

1.17 

21674 

-0.98 

47 

42 

0.51 

1.12 

0.45 

0.70 

-0.22 

0.00 

0.31 

0.98 

21675 

-2.04 

44 

41 

0.64 

0.68 

-0.63 

0.23 

-0.76 

0.00 

0.47 

1.24 

21676 

-1.94 

45 

41 

0.63 

0.81 

-0.33 

0.52 

-0.21 

0.00 

0.53 

1.13 

21677 

-1.60 

45 

41 

0.57 

0.73 

-0.60 

0.46 

-0.48 

0.00 

0.44 

1.19 

21678 

-0.89 

45 

40 

0.52 

1.10 

0.40 

0.92 

0.14 

0.00 

0.31 

0.94 

21679 

-1.33 

45 

40 

0.52 

1.07 

0.32 

1.05 

0.36 

0.00 

0.31 

0.90 

21680 

0.81 

45 

28 

0.36 

1.04 

0.28 

1.13 

0.57 

0.00 

0.45 

0.87 

21681 

-2.70 

44 

42 

0.77 

0.98 

0.16 

0.39 

-0.12 

0.00 

0.33 

1.06 

21682 

-2.19 

43 

41 

0.76 

0.74 

-0.27 

0.28 

-0.52 

0.00 

0.39 

1.16 

21683 

-2.40 

45 

43 

0.76 

1.13 

0.40 

0.76 

0.21 

0.00 

0.20 

0.96 

21684 

-1.71 

45 

41 

0.61 

0.75 

-0.45 

0.42 

-0.53 

0.00 

0.57 

1.17 

21685 

-1.69 

45 

41 

0.57 

0.76 

-0.60 

0.29 

-0.55 

0.00 

0.46 

1.24 

21686 

0.49 

44 

30 

0.36 

0.80 

-1.29 

0.65 

-1.43 

0.00 

0.60 

1.43 

21687 

-1.32 

45 

39 

0.50 

0.90 

-0.21 

0.53 

-0.54 

0.00 

0.49 

1.13 

21688 

-0.28 

41 

31 

0.42 

0.97 

-0.06 

0.74 

-0.51 

0.00 

0.48 

1.11 

21689 

-1.11 

43 

37 

0.49 

0.74 

-0.89 

0.39 

-0.88 

0.00 

0.55 

1.28 
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Appendix  D:  Item  Statistics 


Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21690 

-1.01 

45 

37 

0.43 

0.82 

-0.73 

0.53 

-0.86 

0.00 

0.53 

1.24 

21691 

-1.24 

44 

38 

0.47 

0.84 

-0.48 

0.53 

-0.57 

0.00 

0.44 

1.19 

21692 

-1.48 

44 

38 

0.48 

0.83 

-0.56 

0.43 

-0.73 

0.00 

0.49 

1.22 

21693 

-1.55 

45 

41 

0.58 

0.88 

-0.17 

0.37 

-0.65 

0.00 

0.46 

1.15 

21694 

-1.13 

47 

41 

0.47 

0.65 

-1.23 

0.33 

-1.18 

0.00 

0.59 

1.33 

21695 

-1.06 

44 

37 

0.47 

0.86 

-0.41 

0.68 

-0.28 

0.00 

0.52 

1.14 

21696 

-1.31 

46 

40 

0.48 

1.23 

0.83 

1.45 

0.76 

0.00 

0.22 

0.78 

21697 

-1.71 

45 

41 

0.55 

0.72 

-0.69 

0.30 

-0.98 

0.00 

0.49 

1.24 

21698 

-1.41 

45 

38 

0.51 

1.20 

0.74 

1.05 

0.34 

0.00 

0.45 

0.84 

21699 

-0.78 

45 

40 

0.50 

1.06 

0.29 

0.74 

-0.17 

0.00 

0.27 

1.00 

21700 

0.18 

46 

35 

0.40 

1.00 

0.07 

0.91 

-0.10 

0.00 

0.45 

1.00 

21701 

0.11 

46 

31 

0.37 

0.96 

-0.23 

0.77 

-0.53 

0.00 

0.53 

1.15 

21702 

-0.72 

46 

39 

0.46 

0.99 

0.03 

0.58 

-0.57 

0.00 

0.45 

1.09 

21703 

-0.29 

44 

34 

0.41 

1.19 

0.89 

1.04 

0.24 

0.00 

0.36 

0.80 

21704 

-0.96 

45 

40 

0.49 

0.85 

-0.36 

0.50 

-0.56 

0.00 

0.39 

1.16 

21705 

-0.39 

210 

174 

0.20 

0.95 

-0.41 

0.80 

-0.80 

0.00 

0.41 

1.08 

21706 

-0.04 

45 

33 

0.40 

0.77 

-1.19 

0.56 

-1.10 

0.00 

0.64 

1.36 

21707 

-0.77 

45 

38 

0.45 

0.80 

-0.67 

0.74 

-0.36 

0.00 

0.49 

1.17 

21708 

-1.08 

46 

40 

0.51 

0.98 

0.04 

0.80 

0.02 

0.00 

0.43 

1.01 

21709 

-1.00 

45 

40 

0.51 

1.02 

0.16 

1.06 

0.30 

0.00 

0.29 

0.96 

21710 

-0.97 

45 

38 

0.45 

0.96 

-0.07 

0.58 

-0.48 

0.00 

0.42 

1.12 

21711 

-0.82 

44 

36 

0.43 

0.79 

-0.92 

0.55 

-0.70 

0.00 

0.50 

1.29 

21712 

-0.82 

45 

36 

0.43 

0.99 

0.04 

0.73 

-0.25 

0.00 

0.48 

1.05 

21713 

0.02 

45 

32 

0.38 

0.91 

-0.45 

0.83 

-0.30 

0.00 

0.54 

1.15 

21714 

-0.66 

44 

36 

0.46 

0.94 

-0.15 

0.80 

-0.01 

0.00 

0.49 

1.08 

21715 

-0.14 

46 

33 

0.38 

1.07 

0.43 

1.44 

1.06 

0.00 

0.41 

0.81 

21716 

-1.50 

45 

40 

0.52 

1.02 

0.18 

0.69 

-0.15 

0.00 

0.34 

1.02 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21717 

-0.19 

45 

34 

0.39 

1.05 

0.34 

1.01 

0.17 

0.00 

0.40 

0.92 

21718 

-0.07 

43 

31 

0.39 

0.94 

-0.30 

0.85 

-0.12 

0.00 

0.48 

1.10 

21719 

-1.06 

45 

39 

0.47 

1.00 

0.10 

1.40 

0.74 

0.00 

0.25 

0.91 

21720 

0.00 

45 

32 

0.39 

0.92 

-0.39 

1.02 

0.20 

0.00 

0.54 

1.08 

21721 

0.56 

45 

29 

0.35 

0.84 

-1.03 

0.72 

-1.11 

0.00 

0.57 

1.37 

21722 

0.18 

44 

31 

0.39 

0.87 

-0.66 

0.80 

-0.54 

0.00 

0.54 

1.22 

21723 

-0.23 

45 

35 

0.40 

0.86 

-0.65 

0.73 

-0.70 

0.00 

0.50 

1.20 

21724 

0.20 

46 

33 

0.38 

0.88 

-0.56 

0.71 

-0.69 

0.00 

0.57 

1.20 

21725 

0.98 

45 

27 

0.37 

0.85 

-0.88 

0.81 

-0.79 

0.00 

0.62 

1.30 

21726 

-0.26 

45 

34 

0.39 

0.70 

-1.75 

0.49 

-1.17 

0.00 

0.61 

1.48 

21727 

0.19 

45 

30 

0.37 

1.02 

0.18 

1.05 

0.27 

0.00 

0.49 

0.93 

21728 

-0.66 

45 

35 

0.42 

1.04 

0.23 

0.75 

-0.36 

0.00 

0.47 

1.03 

21729 

-0.54 

45 

36 

0.43 

0.86 

-0.51 

0.60 

-0.87 

0.00 

0.53 

1.21 

21730 

-0.32 

45 

35 

0.41 

0.79 

-0.91 

0.98 

0.09 

0.00 

0.53 

1.19 

21731 

-0.89 

219 

195 

0.23 

1.07 

0.50 

1.18 

0.65 

0.00 

0.25 

0.94 

21732 

-0.79 

45 

39 

0.47 

0.89 

-0.27 

0.59 

-0.58 

0.00 

0.45 

1.13 

21733 

-0.29 

45 

33 

0.39 

0.95 

-0.20 

0.74 

-0.47 

0.00 

0.50 

1.13 

21734 

-0.95 

44 

39 

0.50 

0.93 

-0.11 

0.61 

-0.41 

0.00 

0.36 

1.10 

21735 

-0.45 

44 

36 

0.44 

0.72 

-1.13 

0.57 

-0.89 

0.00 

0.58 

1.29 

21736 

0.02 

46 

35 

0.43 

0.81 

-0.84 

0.62 

-0.66 

0.00 

0.62 

1.27 

21737 

-1.13 

45 

40 

0.51 

0.70 

-0.88 

0.41 

-0.90 

0.00 

0.52 

1.25 

21738 

-0.29 

44 

34 

0.43 

0.79 

-0.87 

0.52 

-0.82 

0.00 

0.62 

1.29 

21739 

-0.25 

45 

35 

0.39 

1.00 

0.06 

1.55 

1.23 

0.00 

0.34 

0.92 

21740 

-1.02 

46 

40 

0.48 

0.87 

-0.32 

0.69 

-0.32 

0.00 

0.42 

1.11 

21741 

-0.38 

45 

36 

0.44 

1.08 

0.39 

0.95 

0.04 

0.00 

0.43 

0.93 

21742 

0.03 

45 

33 

0.38 

0.94 

-0.31 

0.79 

-0.50 

0.00 

0.48 

1.14 

21743 

-0.93 

46 

38 

0.43 

0.82 

-0.76 

0.51 

-0.82 

0.00 

0.50 

1.25 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21744 

-0.29 

46 

36 

0.40 

0.77 

-1.11 

0.55 

-1.28 

0.00 

0.59 

1.33 

21745 

0.01 

45 

34 

0.42 

1.05 

0.29 

0.98 

0.13 

0.00 

0.51 

0.95 

21746 

0.89 

46 

25 

0.34 

0.71 

-2.16 

0.58 

-1.95 

0.00 

0.70 

1.64 

21747 

-0.31 

45 

35 

0.39 

0.93 

-0.31 

0.81 

-0.40 

0.00 

0.44 

1.12 

21748 

-0.27 

45 

36 

0.44 

0.98 

-0.01 

0.79 

-0.26 

0.00 

0.51 

1.05 

21749 

-1.61 

46 

42 

0.60 

0.58 

-1.07 

0.23 

-0.75 

0.00 

0.56 

1.30 

21750 

-1.58 

45 

41 

0.58 

0.95 

-0.01 

0.50 

-0.20 

0.00 

0.39 

1.08 

21751 

-1.80 

44 

41 

0.64 

0.82 

-0.24 

0.57 

-0.17 

0.00 

0.37 

1.11 

21752 

1.76 

45 

21 

0.34 

1.55 

3.47 

1.83 

3.53 

0.00 

0.05 

-0.51 

21753 

0.46 

46 

33 

0.37 

1.16 

0.89 

1.12 

0.48 

0.00 

0.35 

0.77 

21754 

-1.13 

46 

40 

0.50 

0.77 

-0.63 

0.54 

-0.52 

0.00 

0.51 

1.19 

21755 

-0.74 

45 

37 

0.46 

0.98 

0.01 

0.54 

-0.47 

0.00 

0.53 

1.10 

21756 

-2.04 

43 

40 

0.65 

0.56 

-0.97 

0.17 

-0.77 

0.00 

0.54 

1.29 

21757 

-0.68 

44 

36 

0.44 

0.82 

-0.62 

0.90 

-0.03 

0.00 

0.47 

1.15 

21758 

-1.40 

46 

41 

0.50 

0.96 

0.00 

0.63 

-0.40 

0.00 

0.34 

1.08 

21759 

-0.89 

44 

37 

0.48 

1.20 

0.76 

0.90 

0.10 

0.00 

0.37 

0.86 

21760 

-0.52 

44 

37 

0.45 

0.82 

-0.63 

0.54 

-0.72 

0.00 

0.49 

1.22 

21761 

-1.40 

46 

41 

0.52 

0.82 

-0.40 

0.57 

-0.58 

0.00 

0.43 

1.15 

21762 

-0.65 

46 

38 

0.44 

0.76 

-0.94 

0.48 

-1.03 

0.00 

0.58 

1.28 

21763 

-0.54 

45 

35 

0.40 

0.99 

0.00 

0.72 

-0.52 

0.00 

0.45 

1.09 

21764 

-1.64 

45 

41 

0.57 

0.95 

0.00 

1.71 

0.98 

0.00 

0.33 

0.98 

21765 

-1.04 

45 

38 

0.46 

1.32 

1.15 

2.45 

1.82 

0.00 

0.15 

0.59 

21766 

-1.71 

46 

42 

0.55 

0.76 

-0.56 

0.34 

-0.90 

0.00 

0.42 

1.22 

21767 

-1.40 

45 

41 

0.58 

0.88 

-0.18 

0.38 

-0.53 

0.00 

0.46 

1.15 

21768 

-0.69 

45 

37 

0.43 

0.76 

-0.99 

0.48 

-1.12 

0.00 

0.58 

1.30 

21769 

-0.69 

45 

36 

0.42 

0.86 

-0.62 

0.64 

-0.51 

0.00 

0.49 

1.21 

21770 

-0.38 

44 

33 

0.41 

1.13 

0.63 

1.17 

0.52 

0.00 

0.44 

0.84 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21771 

-0.71 

46 

37 

0.45 

0.96 

-0.08 

0.68 

-0.39 

0.00 

0.53 

1.09 

21772 

-0.75 

45 

39 

0.49 

0.82 

-0.52 

1.14 

0.42 

0.00 

0.48 

1.09 

21773 

-1.59 

45 

43 

0.74 

0.97 

0.17 

0.65 

-0.10 

0.00 

0.21 

1.04 

21774 

-0.20 

46 

36 

0.41 

0.97 

-0.06 

1.53 

1.11 

0.00 

0.41 

0.96 

21775 

-1.06 

46 

40 

0.49 

1.02 

0.18 

1.13 

0.41 

0.00 

0.38 

0.98 

21776 

-0.65 

46 

38 

0.43 

0.74 

-1.11 

0.50 

-0.70 

0.00 

0.53 

1.32 

21777 

-0.25 

47 

37 

0.39 

0.73 

-1.39 

0.51 

-0.98 

0.00 

0.57 

1.39 

21778 

-0.96 

46 

40 

0.49 

0.60 

-1.43 

0.36 

-1.30 

0.00 

0.60 

1.35 

21779 

-0.89 

45 

38 

0.50 

0.93 

-0.10 

0.63 

-0.36 

0.00 

0.55 

1.09 

21780 

-1.48 

45 

41 

0.62 

0.98 

0.12 

0.71 

-0.04 

0.00 

0.44 

1.03 

21781 

-1.05 

43 

36 

0.51 

0.74 

-0.87 

0.46 

-0.64 

0.00 

0.59 

1.27 

21782 

-0.97 

45 

39 

0.50 

0.76 

-0.81 

0.34 

-0.68 

0.00 

0.56 

1.28 

21783 

-1.71 

45 

41 

0.61 

0.70 

-0.57 

0.29 

-0.84 

0.00 

0.62 

1.21 

21784 

-1.01 

45 

39 

0.49 

0.54 

-1.69 

0.29 

-1.64 

0.00 

0.61 

1.41 

21785 

-1.65 

43 

39 

0.58 

0.87 

-0.26 

0.33 

-0.51 

0.00 

0.46 

1.18 

21786 

-1.38 

46 

42 

0.56 

0.76 

-0.53 

0.40 

-0.60 

0.00 

0.43 

1.20 

21787 

-0.38 

45 

34 

0.41 

0.71 

-1.31 

0.48 

-0.95 

0.00 

0.67 

1.36 

21788 

-0.86 

46 

40 

0.50 

0.77 

-0.69 

0.51 

-0.54 

0.00 

0.49 

1.21 

21789 

-1.12 

45 

39 

0.49 

0.82 

-0.51 

0.55 

-0.53 

0.00 

0.50 

1.18 

21790 

-1.28 

45 

41 

0.56 

0.72 

-0.67 

0.31 

-0.91 

0.00 

0.52 

1.24 

21791 

-0.78 

45 

36 

0.42 

0.75 

-1.14 

0.60 

-0.66 

0.00 

0.55 

1.30 

21792 

-0.44 

46 

37 

0.43 

1.35 

1.36 

2.08 

1.94 

0.00 

0.20 

0.51 

21793 

-0.78 

45 

39 

0.47 

0.73 

-0.89 

0.42 

-0.99 

0.00 

0.51 

1.28 

21794 

-1.61 

45 

42 

0.64 

0.90 

-0.06 

0.62 

-0.08 

0.00 

0.37 

1.07 

21795 

-1.20 

45 

40 

0.52 

0.96 

-0.01 

0.84 

0.07 

0.00 

0.38 

1.03 

21796 

-1.41 

44 

37 

0.52 

0.73 

-0.78 

0.34 

-0.83 

0.00 

0.70 

1.25 

21797 

-0.96 

45 

37 

0.43 

0.77 

-1.02 

0.48 

-0.82 

0.00 

0.54 

1.31 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21798 

-1.72 

44 

40 

0.60 

1.10 

0.36 

1.19 

0.50 

0.00 

0.33 

0.91 

21799 

1.69 

46 

22 

0.36 

0.65 

-2.56 

0.52 

-2.12 

0.00 

0.74 

1.73 

21800 

0.29 

45 

33 

0.41 

0.76 

-1.18 

0.78 

-0.43 

0.00 

0.62 

1.29 

21801 

2.58 

45 

13 

0.40 

1.20 

0.95 

1.24 

0.69 

0.00 

0.46 

0.73 

21802 

0.28 

44 

31 

0.39 

1.35 

1.70 

2.23 

2.71 

0.00 

0.27 

0.27 

21803 

3.49 

45 

10 

0.42 

0.65 

-1.55 

0.42 

-1.45 

0.00 

0.71 

1.41 

21804 

-0.82 

43 

36 

0.44 

0.96 

-0.08 

1.63 

1.04 

0.00 

0.30 

0.95 

21805 

2.04 

45 

16 

0.36 

0.93 

-0.39 

0.95 

-0.12 

0.00 

0.51 

1.11 

21806 

3.14 

45 

9 

0.40 

1.11 

0.57 

2.60 

2.77 

0.00 

0.18 

0.76 

21807 

2.65 

248 

74 

0.15 

0.93 

-0.96 

1.00 

0.05 

0.00 

0.47 

1.10 

21808 

2.91 

45 

14 

0.39 

0.81 

-1.02 

0.64 

-1.06 

0.00 

0.67 

1.32 

21809 

3.57 

45 

9 

0.45 

1.31 

1.13 

1.66 

1.22 

0.00 

0.32 

0.64 

21810 

3.03 

46 

11 

0.40 

1.17 

0.88 

1.23 

0.60 

0.00 

0.34 

0.72 

21811 

2.44 

46 

12 

0.38 

1.18 

0.93 

3.97 

4.10 

0.00 

0.23 

0.42 

21812 

1.67 

45 

20 

0.37 

0.80 

-1.19 

0.85 

-0.43 

0.00 

0.65 

1.33 

21813 

-1.13 

45 

39 

0.50 

1.13 

0.48 

1.95 

1.19 

0.00 

0.31 

0.82 

21814 

-0.52 

45 

37 

0.43 

1.02 

0.18 

1.23 

0.59 

0.00 

0.32 

0.91 

21815 

3.39 

44 

8 

0.44 

1.05 

0.29 

3.78 

2.35 

0.00 

0.33 

0.79 

21816 

-0.44 

44 

37 

0.47 

0.75 

-0.97 

0.44 

-0.83 

0.00 

0.57 

1.30 

21817 

1.78 

45 

16 

0.37 

0.93 

-0.34 

0.83 

-0.38 

0.00 

0.55 

1.14 

21818 

2.47 

44 

12 

0.39 

0.97 

-0.09 

1.55 

1.11 

0.00 

0.43 

0.94 

21819 

2.08 

44 

19 

0.37 

1.08 

0.54 

1.00 

0.11 

0.00 

0.52 

0.86 

21820 

1.68 

45 

22 

0.36 

1.20 

1.34 

1.15 

0.56 

0.00 

0.46 

0.58 

21821 

3.30 

46 

9 

0.45 

0.84 

-0.55 

0.58 

-0.61 

0.00 

0.60 

1.19 

21822 

2.90 

45 

11 

0.44 

1.34 

1.32 

3.67 

2.83 

0.00 

0.37 

0.41 

21823 

-0.15 

45 

35 

0.40 

1.06 

0.35 

0.97 

0.07 

0.00 

0.37 

0.93 

21824 

2.69 

44 

16 

0.39 

0.91 

-0.44 

0.92 

-0.02 

0.00 

0.59 

1.12 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21825 

1.75 

44 

16 

0.36 

1.00 

0.02 

0.98 

-0.01 

0.00 

0.47 

1.02 

21826 

-1.47 

46 

42 

0.58 

0.78 

-0.47 

0.47 

-0.49 

0.00 

0.43 

1.16 

21827 

3.25 

44 

11 

0.44 

1.05 

0.30 

3.15 

2.80 

0.00 

0.49 

0.73 

21828 

2.36 

44 

16 

0.36 

0.99 

-0.03 

1.49 

1.51 

0.00 

0.47 

0.91 

21829 

3.16 

45 

10 

0.42 

1.04 

0.24 

3.05 

2.33 

0.00 

0.40 

0.81 

21830 

2.66 

45 

14 

0.38 

0.82 

-1.01 

1.02 

0.16 

0.00 

0.61 

1.23 

21831 

3.08 

46 

11 

0.43 

1.13 

0.57 

4.03 

2.88 

0.00 

0.42 

0.69 

21832 

1.59 

45 

22 

0.35 

0.73 

-2.08 

0.66 

-1.44 

0.00 

0.66 

1.64 

21833 

1.14 

46 

26 

0.34 

1.02 

0.20 

0.92 

-0.21 

0.00 

0.49 

0.99 

21834 

3.27 

45 

9 

0.45 

0.88 

-0.39 

0.82 

-0.21 

0.00 

0.59 

1.11 

21835 

2.27 

46 

16 

0.38 

1.07 

0.43 

1.67 

1.84 

0.00 

0.49 

0.77 

21836 

3.16 

44 

11 

0.41 

0.74 

-1.29 

0.54 

-0.94 

0.00 

0.64 

1.36 

21837 

2.59 

181 

67 

0.18 

0.95 

-0.62 

1.02 

0.20 

0.00 

0.53 

1.06 

21838 

3.27 

45 

11 

0.42 

1.08 

0.44 

1.17 

0.47 

0.00 

0.48 

0.87 

21839 

-0.14 

45 

34 

0.40 

0.76 

-1.19 

0.53 

-0.88 

0.00 

0.61 

1.35 

21840 

2.89 

203 

59 

0.18 

0.96 

-0.38 

1.24 

1.17 

0.00 

0.48 

1.00 

21841 

0.09 

48 

34 

0.36 

1.13 

0.73 

1.01 

0.14 

0.00 

0.38 

0.85 

21842 

-1.17 

181 

166 

0.29 

0.98 

-0.01 

1.42 

0.98 

0.00 

0.28 

0.98 

21843 

3.56 

46 

10 

0.46 

0.71 

-1.06 

0.62 

-0.70 

0.00 

0.73 

1.25 

21844 

2.57 

198 

57 

0.18 

1.01 

0.11 

1.23 

1.43 

0.00 

0.42 

0.93 

21845 

0.47 

46 

30 

0.35 

0.94 

-0.38 

0.79 

-0.66 

0.00 

0.52 

1.18 

21846 

4.53 

46 

4 

0.63 

1.09 

0.35 

1.12 

0.46 

0.00 

0.35 

0.92 

21847 

3.85 

45 

6 

0.47 

1.01 

0.12 

1.88 

1.38 

0.00 

0.21 

0.88 

21848 

4.78 

46 

5 

0.58 

1.06 

0.27 

5.05 

2.43 

0.00 

0.33 

0.75 

21849 

3.93 

44 

6 

0.52 

0.83 

-0.48 

0.58 

-0.35 

0.00 

0.57 

1.16 

21850 

3.50 

45 

6 

0.47 

0.96 

-0.06 

3.83 

2.58 

0.00 

0.23 

0.84 

21851 

6.45 

46 

2 

1.06 

1.10 

0.40 

0.34 

-0.16 

0.00 

0.51 

1.00 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21852 

4.04 

44 

8 

0.50 

1.17 

0.69 

4.86 

2.50 

0.00 

0.42 

0.65 

21853 

3.68 

45 

7 

0.45 

0.70 

-1.15 

0.39 

-1.04 

0.00 

0.60 

1.32 

21854 

1.84 

45 

20 

0.37 

0.88 

-0.84 

0.78 

-0.54 

0.00 

0.62 

1.30 

21855 

4.42 

45 

5 

0.52 

0.88 

-0.27 

5.91 

2.94 

0.00 

0.29 

0.90 

21856 

1.59 

45 

20 

0.35 

1.01 

0.10 

0.97 

-0.04 

0.00 

0.52 

1.00 

21857 

2.82 

46 

13 

0.40 

1.05 

0.29 

3.21 

3.66 

0.00 

0.41 

0.69 

21858 

1.36 

45 

22 

0.37 

0.99 

0.01 

1.03 

0.20 

0.00 

0.58 

0.99 

21859 

2.28 

45 

17 

0.38 

1.27 

1.43 

1.58 

1.15 

0.00 

0.41 

0.46 

21860 

2.18 

44 

16 

0.39 

0.95 

-0.21 

0.91 

-0.09 

0.00 

0.59 

1.08 

21861 

1.70 

44 

20 

0.39 

0.87 

-0.70 

0.92 

-0.19 

0.00 

0.66 

1.18 

21862 

1.77 

50 

21 

0.34 

0.98 

-0.07 

0.97 

-0.04 

0.00 

0.52 

1.03 

21863 

-1.29 

43 

37 

0.48 

0.86 

-0.39 

0.98 

0.18 

0.00 

0.41 

1.07 

21864 

1.24 

46 

23 

0.34 

0.80 

-1.59 

0.70 

-1.55 

0.00 

0.62 

1.57 

21865 

1.84 

45 

17 

0.36 

1.10 

0.67 

1.07 

0.32 

0.00 

0.46 

0.81 

21866 

1.06 

44 

26 

0.36 

1.08 

0.57 

1.25 

0.95 

0.00 

0.46 

0.77 

21867 

1.28 

43 

21 

0.36 

0.76 

-1.59 

0.65 

-1.58 

0.00 

0.68 

1.51 

21868 

2.58 

45 

14 

0.39 

1.02 

0.18 

1.54 

1.30 

0.00 

0.50 

0.85 

21869 

2.56 

45 

15 

0.38 

1.27 

1.45 

1.14 

0.46 

0.00 

0.40 

0.60 

21870 

3.37 

45 

7 

0.52 

1.07 

0.32 

1.30 

0.61 

0.00 

0.48 

0.88 

21871 

1.73 

44 

19 

0.37 

1.23 

1.36 

1.50 

1.65 

0.00 

0.43 

0.42 

21872 

1.74 

45 

18 

0.37 

0.70 

-1.98 

0.56 

-1.01 

0.00 

0.68 

1.58 

21873 

0.64 

45 

26 

0.36 

0.89 

-0.67 

0.72 

-0.94 

0.00 

0.60 

1.27 

21874 

2.26 

45 

16 

0.38 

0.58 

-2.64 

0.55 

-1.61 

0.00 

0.77 

1.63 

21875 

-0.90 

44 

38 

0.48 

1.08 

0.37 

0.79 

-0.18 

0.00 

0.32 

0.97 

21876 

2.29 

45 

16 

0.36 

1.17 

1.00 

1.28 

0.72 

0.00 

0.38 

0.66 

21877 

3.34 

44 

8 

0.43 

0.96 

-0.10 

1.93 

1.54 

0.00 

0.31 

0.93 

21878 

2.84 

46 

13 

0.40 

1.00 

0.05 

1.06 

0.29 

0.00 

0.55 

0.99 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

21879 

0.00 

45 

1 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

21880 

5.56 

44 

2 

0.78 

1.19 

0.51 

9.90 

3.86 

0.00 

0.03 

0.62 

21881 

2.26 

45 

16 

0.40 

0.80 

-1.04 

0.96 

0.03 

0.00 

0.68 

1.24 

21882 

-2.46 

44 

42 

0.76 

0.77 

-0.21 

0.36 

-0.34 

0.00 

0.36 

1.13 

21883 

0.76 

45 

27 

0.36 

1.04 

0.29 

0.96 

-0.08 

0.00 

0.50 

0.95 

21884 

1.47 

46 

24 

0.37 

0.94 

-0.27 

0.85 

-0.50 

0.00 

0.62 

1.13 

21885 

1.43 

45 

23 

0.34 

0.96 

-0.22 

1.22 

1.07 

0.00 

0.49 

0.98 

21886 

1.67 

45 

19 

0.34 

0.85 

-1.11 

0.88 

-0.48 

0.00 

0.53 

1.33 

21887 

0.88 

44 

27 

0.36 

1.15 

1.01 

1.23 

0.86 

0.00 

0.39 

0.65 

21888 

1.30 

45 

23 

0.35 

0.80 

-1.44 

0.70 

-1.42 

0.00 

0.63 

1.50 

21889 

1.96 

45 

19 

0.38 

0.67 

-2.04 

0.53 

-1.46 

0.00 

0.74 

1.59 

21890 

1.17 

45 

26 

0.38 

0.94 

-0.25 

1.04 

0.24 

0.00 

0.60 

1.06 

21891 

1.25 

45 

23 

0.35 

1.23 

1.45 

1.25 

1.15 

0.00 

0.37 

0.52 

21892 

0.93 

45 

27 

0.34 

1.20 

1.45 

1.28 

1.07 

0.00 

0.29 

0.47 

21893 

1.81 

55 

24 

0.32 

1.05 

0.41 

0.94 

-0.19 

0.00 

0.50 

0.95 

21894 

1.67 

44 

18 

0.37 

0.86 

-0.82 

0.83 

-0.56 

0.00 

0.62 

1.26 

21895 

-0.83 

44 

38 

0.49 

0.94 

-0.08 

0.76 

-0.18 

0.00 

0.39 

1.06 

21896 

1.51 

45 

20 

0.34 

1.00 

0.07 

0.92 

-0.38 

0.00 

0.47 

1.04 

21897 

-1.14 

46 

40 

0.50 

0.94 

-0.12 

0.83 

0.07 

0.00 

0.43 

1.04 

21898 

-0.82 

44 

37 

0.49 

1.00 

0.10 

1.07 

0.31 

0.00 

0.45 

0.97 

21899 

1.79 

44 

17 

0.35 

1.23 

1.60 

1.81 

2.52 

0.00 

0.20 

0.20 

21900 

1.65 

46 

21 

0.34 

0.84 

-1.17 

0.77 

-0.79 

0.00 

0.59 

1.39 

22001 

-1.07 

45 

40 

0.54 

0.87 

-0.27 

0.56 

-0.29 

0.00 

0.50 

1.11 

22002 

-1.47 

46 

42 

0.59 

1.03 

0.20 

0.75 

-0.04 

0.00 

0.38 

1.01 

22003 

-2.06 

46 

42 

0.58 

1.28 

0.79 

0.85 

0.17 

0.00 

0.26 

0.87 

22004 

-2.59 

46 

44 

0.78 

0.89 

0.01 

0.59 

0.08 

0.00 

0.32 

1.05 

22005 

-0.23 

46 

35 

0.38 

0.96 

-0.15 

1.31 

0.83 

0.00 

0.37 

0.99 
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Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22006 

-1.78 

45 

41 

0.58 

0.88 

-0.19 

2.26 

1.26 

0.00 

0.32 

0.96 

22007 

-1.30 

45 

41 

0.55 

1.11 

0.40 

0.81 

0.01 

0.00 

0.22 

0.96 

22008 

-1.71 

45 

41 

0.57 

0.91 

-0.10 

0.93 

0.22 

0.00 

0.33 

1.04 

22009 

-1.82 

46 

42 

0.57 

0.84 

-0.32 

0.36 

-0.56 

0.00 

0.45 

1.17 

22010 

-0.42 

45 

36 

0.43 

1.17 

0.78 

1.25 

0.64 

0.00 

0.36 

0.80 

22011 

-2.00 

45 

42 

0.62 

0.89 

-0.08 

0.47 

-0.32 

0.00 

0.34 

1.10 

22012 

-1.96 

44 

41 

0.65 

0.87 

-0.15 

0.28 

-0.54 

0.00 

0.44 

1.16 

22013 

-0.93 

46 

39 

0.45 

0.71 

-1.09 

0.46 

-0.85 

0.00 

0.53 

1.31 

22014 

-1.25 

44 

38 

0.49 

0.83 

-0.49 

0.74 

-0.25 

0.00 

0.50 

1.14 

22015 

-0.09 

45 

34 

0.39 

1.19 

0.95 

1.03 

0.23 

0.00 

0.32 

0.80 

22016 

-1.60 

45 

40 

0.54 

0.81 

-0.43 

0.47 

-0.56 

0.00 

0.53 

1.17 

22017 

-1.25 

45 

39 

0.53 

1.03 

0.21 

1.70 

1.00 

0.00 

0.44 

0.93 

22018 

-1.03 

45 

38 

0.46 

0.86 

-0.47 

0.53 

-0.54 

0.00 

0.48 

1.19 

22019 

-3.73 

45 

44 

1.19 

0.33 

-0.72 

0.03 

-0.98 

0.00 

0.54 

1.25 

22020 

-1.79 

45 

40 

0.53 

0.93 

-0.10 

0.83 

0.09 

0.00 

0.41 

1.05 

22021 

-1.52 

45 

40 

0.51 

0.84 

-0.40 

0.40 

-0.63 

0.00 

0.48 

1.19 

22022 

-1.57 

41 

36 

0.56 

0.98 

0.06 

0.58 

-0.25 

0.00 

0.48 

1.06 

22023 

-0.09 

45 

34 

0.40 

1.17 

0.82 

1.51 

1.29 

0.00 

0.35 

0.72 

22024 

-3.12 

46 

45 

1.05 

1.03 

0.33 

0.29 

-0.24 

0.00 

0.23 

1.05 

22025 

-2.14 

45 

41 

0.63 

1.00 

0.15 

0.41 

-0.43 

0.00 

0.51 

1.08 

22026 

-1.59 

46 

43 

0.63 

0.83 

-0.22 

1.37 

0.67 

0.00 

0.29 

1.05 

22027 

0.00 

45 

45 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

22028 

-3.25 

45 

44 

1.04 

1.01 

0.31 

0.30 

-0.23 

0.00 

0.23 

1.04 

22029 

-1.29 

46 

40 

0.49 

1.05 

0.27 

0.80 

-0.03 

0.00 

0.37 

0.98 

22030 

-2.38 

43 

41 

0.78 

0.75 

-0.25 

0.38 

-0.19 

0.00 

0.40 

1.13 

22031 

-0.71 

46 

38 

0.45 

1.00 

0.08 

0.60 

-0.58 

0.00 

0.49 

1.09 

22032 

-1.16 

44 

36 

0.43 

1.00 

0.09 

0.70 

-0.33 

0.00 

0.41 

1.05 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22033 

-1.86 

45 

43 

0.75 

1.11 

0.38 

1.04 

0.43 

0.00 

0.13 

0.92 

22034 

0.00 

45 

45 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

22035 

-4.88 

44 

43 

1.35 

1.88 

1.11 

0.15 

-0.52 

0.00 

0.35 

0.84 

22036 

-3.05 

45 

44 

1.04 

1.06 

0.37 

0.56 

0.10 

0.00 

0.15 

0.99 

22037 

-1.08 

44 

37 

0.45 

0.96 

-0.08 

0.72 

-0.28 

0.00 

0.42 

1.08 

22038 

-2.99 

44 

43 

1.03 

0.98 

0.28 

0.38 

-0.11 

0.00 

0.19 

1.05 

22039 

-4.46 

46 

45 

1.46 

0.17 

-0.77 

0.01 

-1.14 

0.00 

0.66 

1.25 

22040 

-1.95 

45 

42 

0.63 

0.94 

0.01 

0.57 

-0.21 

0.00 

0.32 

1.07 

22041 

0.00 

45 

45 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

22042 

-0.36 

46 

35 

0.42 

1.09 

0.47 

0.97 

0.08 

0.00 

0.50 

0.91 

22043 

-0.88 

46 

39 

0.45 

0.82 

-0.64 

0.53 

-0.60 

0.00 

0.46 

1.21 

22044 

-1.85 

44 

40 

0.56 

1.08 

0.34 

0.87 

0.13 

0.00 

0.26 

0.97 

22045 

-1.27 

45 

40 

0.57 

0.64 

-0.88 

0.29 

-0.83 

0.00 

0.60 

1.27 

22046 

-0.25 

45 

35 

0.40 

0.92 

-0.32 

0.87 

-0.24 

0.00 

0.44 

1.11 

22047 

-0.05 

45 

32 

0.40 

0.66 

-1.85 

0.47 

-1.30 

0.00 

0.69 

1.49 

22048 

-0.85 

45 

37 

0.45 

0.83 

-0.67 

0.61 

-0.46 

0.00 

0.50 

1.22 

22049 

0.43 

46 

30 

0.36 

1.03 

0.22 

0.91 

-0.22 

0.00 

0.49 

0.99 

22050 

0.00 

45 

45 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

22051 

0.27 

44 

29 

0.38 

1.14 

0.84 

0.99 

0.11 

0.00 

0.46 

0.80 

22052 

0.02 

44 

33 

0.40 

0.77 

-1.18 

0.52 

-1.10 

0.00 

0.61 

1.37 

22053 

-0.04 

45 

33 

0.38 

0.77 

-1.28 

0.62 

-0.91 

0.00 

0.55 

1.38 

22054 

0.33 

46 

31 

0.37 

0.92 

-0.36 

0.81 

-0.55 

0.00 

0.56 

1.15 

22055 

0.04 

44 

34 

0.41 

0.97 

-0.06 

0.90 

-0.09 

0.00 

0.45 

1.04 

22056 

-0.55 

44 

36 

0.43 

0.76 

-0.94 

0.67 

-0.58 

0.00 

0.54 

1.25 

22057 

-0.65 

45 

39 

0.48 

0.81 

-0.60 

0.47 

-0.75 

0.00 

0.48 

1.22 

22058 

-1.05 

45 

39 

0.47 

0.84 

-0.47 

0.55 

-0.49 

0.00 

0.42 

1.18 

22059 

-0.41 

44 

34 

0.44 

0.61 

-1.87 

0.47 

-0.84 

0.00 

0.66 

1.45 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22060 

-0.49 

46 

36 

0.41 

0.88 

-0.50 

0.77 

-0.19 

0.00 

0.50 

1.16 

22061 

0.01 

45 

31 

0.36 

0.91 

-0.51 

0.83 

-0.65 

0.00 

0.48 

1.21 

22062 

-1.03 

44 

37 

0.47 

0.91 

-0.20 

0.71 

-0.38 

0.00 

0.50 

1.10 

22063 

-2.15 

45 

42 

0.65 

0.73 

-0.48 

0.25 

-0.61 

0.00 

0.48 

1.20 

22064 

-2.82 

44 

42 

0.79 

0.96 

0.12 

0.54 

0.08 

0.00 

0.33 

1.03 

22065 

-1.34 

45 

40 

0.52 

1.09 

0.37 

0.78 

-0.06 

0.00 

0.34 

0.97 

22066 

-0.17 

45 

34 

0.38 

1.10 

0.60 

1.03 

0.21 

0.00 

0.31 

0.85 

22067 

0.38 

45 

31 

0.37 

0.89 

-0.60 

0.74 

-0.79 

0.00 

0.54 

1.23 

22068 

-1.80 

45 

41 

0.57 

1.04 

0.24 

0.47 

-0.35 

0.00 

0.38 

1.05 

22069 

-0.59 

45 

38 

0.47 

1.28 

0.98 

1.97 

1.50 

0.00 

0.22 

0.65 

22070 

-0.36 

43 

35 

0.43 

1.02 

0.18 

1.16 

0.45 

0.00 

0.33 

0.95 

22071 

-0.13 

46 

33 

0.37 

0.96 

-0.21 

0.85 

-0.45 

0.00 

0.46 

1.11 

22072 

-0.70 

184 

163 

0.25 

1.04 

0.32 

0.68 

-0.74 

0.00 

0.37 

1.02 

22073 

-1.03 

45 

40 

0.52 

0.70 

-0.90 

0.33 

-0.85 

0.00 

0.50 

1.29 

22074 

0.69 

45 

27 

0.37 

0.79 

-1.26 

0.79 

-0.71 

0.00 

0.65 

1.34 

22075 

-0.10 

45 

33 

0.38 

1.00 

0.05 

0.83 

-0.30 

0.00 

0.46 

1.05 

22076 

-0.24 

45 

36 

0.45 

0.66 

-1.48 

0.41 

-1.30 

0.00 

0.68 

1.41 

22077 

-0.12 

46 

36 

0.41 

0.94 

-0.21 

0.85 

-0.25 

0.00 

0.45 

1.08 

22078 

-1.01 

44 

39 

0.52 

0.80 

-0.58 

1.59 

0.84 

0.00 

0.41 

1.07 

22079 

-1.15 

45 

40 

0.50 

0.91 

-0.18 

0.60 

-0.51 

0.00 

0.37 

1.11 

22080 

-0.63 

44 

35 

0.44 

1.36 

1.39 

1.40 

0.82 

0.00 

0.31 

0.61 

22081 

-0.39 

45 

35 

0.40 

1.06 

0.33 

1.02 

0.18 

0.00 

0.36 

0.94 

22082 

-0.04 

45 

32 

0.39 

1.29 

1.50 

1.13 

0.43 

0.00 

0.40 

0.59 

22083 

-0.25 

43 

33 

0.42 

1.31 

1.42 

2.37 

2.29 

0.00 

0.27 

0.44 

22084 

1.07 

45 

26 

0.38 

0.92 

-0.44 

0.81 

-0.53 

0.00 

0.62 

1.17 

22085 

0.04 

45 

33 

0.38 

1.02 

0.17 

0.90 

-0.18 

0.00 

0.44 

1.00 

22086 

0.70 

46 

30 

0.36 

0.97 

-0.12 

1.01 

0.11 

0.00 

0.50 

1.05 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22087 

-0.07 

45 

31 

0.38 

1.23 

1.23 

1.71 

1.51 

0.00 

0.37 

0.56 

22088 

-0.32 

44 

37 

0.45 

1.20 

0.81 

1.12 

0.39 

0.00 

0.25 

0.79 

22089 

-0.15 

44 

34 

0.41 

1.32 

1.38 

1.32 

0.85 

0.00 

0.26 

0.60 

22090 

-1.36 

44 

39 

0.54 

0.90 

-0.17 

0.64 

-0.05 

0.00 

0.43 

1.09 

22091 

0.35 

45 

33 

0.39 

1.44 

2.08 

2.79 

3.38 

0.00 

0.17 

0.10 

22092 

0.69 

45 

31 

0.37 

1.00 

0.07 

1.17 

0.66 

0.00 

0.43 

0.93 

22093 

-0.06 

45 

33 

0.38 

0.93 

-0.31 

0.88 

-0.26 

0.00 

0.47 

1.10 

22094 

0.14 

45 

31 

0.37 

0.98 

-0.08 

0.87 

-0.26 

0.00 

0.49 

1.06 

22095 

0.01 

45 

31 

0.37 

1.06 

0.40 

0.91 

-0.15 

0.00 

0.47 

0.95 

22096 

0.35 

46 

34 

0.38 

0.90 

-0.51 

0.74 

-0.58 

0.00 

0.51 

1.19 

22097 

-0.85 

45 

37 

0.46 

0.79 

-0.73 

0.51 

-0.94 

0.00 

0.59 

1.24 

22098 

-0.14 

46 

36 

0.40 

0.97 

-0.08 

0.78 

-0.42 

0.00 

0.47 

1.07 

22099 

-1.16 

46 

39 

0.46 

0.87 

-0.46 

0.51 

-0.69 

0.00 

0.48 

1.19 

22100 

-0.89 

45 

39 

0.47 

1.08 

0.36 

1.59 

1.04 

0.00 

0.23 

0.88 

22101 

0.27 

45 

31 

0.40 

0.75 

-1.27 

0.60 

-1.15 

0.00 

0.67 

1.38 

22102 

-0.69 

45 

37 

0.44 

0.72 

-1.17 

0.42 

-1.18 

0.00 

0.57 

1.35 

22103 

-0.68 

44 

37 

0.46 

0.91 

-0.25 

0.87 

-0.02 

0.00 

0.45 

1.07 

22104 

0.62 

45 

29 

0.36 

1.09 

0.64 

1.09 

0.36 

0.00 

0.41 

0.79 

22105 

-0.87 

44 

38 

0.50 

0.80 

-0.61 

0.64 

-0.27 

0.00 

0.50 

1.17 

22106 

-1.74 

180 

170 

0.35 

0.91 

-0.26 

0.53 

-0.79 

0.00 

0.34 

1.06 

22107 

0.01 

2530 

1860 

0.05 

0.98 

-0.88 

0.88 

-2.20 

0.00 

0.48 

1.05 

22108 

-0.11 

45 

34 

0.40 

0.90 

-0.52 

0.85 

-0.17 

0.00 

0.52 

1.15 

22109 

-2.34 

44 

42 

0.78 

0.71 

-0.31 

0.28 

-0.39 

0.00 

0.44 

1.16 

22110 

0.35 

43 

30 

0.40 

0.85 

-0.79 

1.21 

0.64 

0.00 

0.56 

1.16 

22111 

-1.75 

45 

42 

0.62 

0.95 

0.05 

0.61 

-0.15 

0.00 

0.27 

1.06 

22112 

0.18 

45 

31 

0.38 

0.98 

-0.03 

0.85 

-0.36 

0.00 

0.51 

1.07 

22113 

-0.37 

44 

33 

0.41 

0.63 

-2.00 

0.43 

-1.36 

0.00 

0.66 

1.51 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22114 

-0.04 

45 

33 

0.42 

0.91 

-0.37 

0.67 

-0.70 

0.00 

0.61 

1.18 

22115 

-0.50 

210 

175 

0.21 

0.98 

-0.15 

0.87 

-0.45 

0.00 

0.42 

1.04 

22116 

-0.43 

45 

35 

0.40 

1.06 

0.35 

1.05 

0.26 

0.00 

0.36 

0.90 

22117 

-1.88 

45 

42 

0.63 

0.61 

-0.81 

0.20 

-0.94 

0.00 

0.51 

1.26 

22118 

-1.64 

45 

40 

0.53 

0.82 

-0.44 

0.90 

0.13 

0.00 

0.43 

1.10 

22119 

-1.61 

46 

40 

0.49 

0.99 

0.08 

0.59 

-0.25 

0.00 

0.42 

1.07 

22120 

-0.78 

45 

39 

0.48 

0.75 

-0.84 

0.47 

-0.69 

0.00 

0.52 

1.24 

22121 

-1.08 

45 

38 

0.46 

0.74 

-1.07 

0.46 

-0.82 

0.00 

0.54 

1.31 

22122 

-0.73 

44 

34 

0.43 

0.98 

0.00 

0.81 

-0.05 

0.00 

0.51 

1.04 

22123 

-0.64 

46 

37 

0.44 

1.31 

1.19 

1.21 

0.54 

0.00 

0.35 

0.71 

22124 

-1.69 

45 

41 

0.57 

0.99 

0.10 

0.60 

-0.10 

0.00 

0.34 

1.03 

22125 

-3.21 

44 

42 

0.97 

0.99 

0.25 

0.66 

0.20 

0.00 

0.48 

0.99 

22126 

-0.41 

44 

36 

0.45 

1.06 

0.30 

1.54 

0.97 

0.00 

0.39 

0.85 

22127 

-2.64 

46 

44 

0.76 

0.66 

-0.47 

0.14 

-0.57 

0.00 

0.43 

1.22 

22128 

0.12 

44 

28 

0.38 

0.97 

-0.08 

0.90 

-0.25 

0.00 

0.58 

1.06 

22129 

-0.96 

45 

38 

0.45 

0.95 

-0.10 

0.58 

-0.53 

0.00 

0.42 

1.12 

22130 

-0.58 

44 

37 

0.46 

0.80 

-0.81 

0.50 

-0.84 

0.00 

0.50 

1.28 

22131 

-1.93 

44 

41 

0.62 

0.86 

-0.15 

0.60 

-0.29 

0.00 

0.32 

1.10 

22132 

-0.14 

46 

34 

0.38 

0.90 

-0.53 

0.83 

-0.36 

0.00 

0.50 

1.17 

22133 

-0.94 

44 

38 

0.48 

0.97 

-0.02 

0.63 

-0.34 

0.00 

0.39 

1.09 

22134 

-0.29 

46 

37 

0.41 

1.02 

0.18 

0.89 

-0.09 

0.00 

0.37 

0.99 

22135 

-1.21 

45 

40 

0.52 

0.97 

0.05 

1.72 

1.08 

0.00 

0.32 

0.95 

22136 

-1.19 

45 

41 

0.56 

1.20 

0.60 

1.43 

0.76 

0.00 

0.17 

0.85 

22137 

-0.86 

45 

38 

0.45 

0.96 

-0.06 

0.76 

-0.29 

0.00 

0.40 

1.07 

22138 

-0.60 

45 

39 

0.47 

0.89 

-0.29 

0.53 

-0.73 

0.00 

0.44 

1.16 

22139 

-0.67 

49 

42 

0.45 

0.84 

-0.53 

0.53 

-0.88 

0.00 

0.48 

1.20 

22140 

-1.29 

45 

40 

0.51 

1.16 

0.58 

1.03 

0.31 

0.00 

0.25 

0.88 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22141 

-0.50 

46 

36 

0.43 

0.83 

-0.68 

0.67 

-0.50 

0.00 

0.56 

1.20 

22142 

0.04 

44 

32 

0.42 

1.07 

0.40 

1.30 

0.74 

0.00 

0.52 

0.87 

22143 

-0.75 

47 

39 

0.46 

1.06 

0.31 

1.78 

1.17 

0.00 

0.38 

0.80 

22144 

0.27 

45 

33 

0.39 

1.38 

1.91 

1.40 

0.89 

0.00 

0.28 

0.39 

22145 

-0.69 

43 

35 

0.47 

1.21 

0.78 

1.19 

0.50 

0.00 

0.40 

0.80 

22146 

-0.93 

45 

38 

0.46 

0.93 

-0.20 

0.83 

-0.07 

0.00 

0.40 

1.07 

22147 

-0.12 

44 

33 

0.39 

0.84 

-0.83 

0.89 

-0.18 

0.00 

0.48 

1.20 

22148 

-0.89 

45 

35 

0.42 

0.92 

-0.33 

0.83 

-0.08 

0.00 

0.48 

1.11 

22149 

-0.56 

45 

36 

0.43 

0.81 

-0.78 

0.56 

-0.90 

0.00 

0.60 

1.24 

22150 

-1.12 

45 

38 

0.46 

1.20 

0.79 

0.99 

0.20 

0.00 

0.31 

0.85 

22151 

-0.04 

46 

34 

0.38 

0.93 

-0.31 

1.00 

0.12 

0.00 

0.49 

1.08 

22152 

-0.95 

45 

38 

0.45 

0.83 

-0.60 

0.54 

-0.73 

0.00 

0.48 

1.22 

22153 

-1.36 

45 

41 

0.57 

0.82 

-0.38 

0.31 

-0.76 

0.00 

0.50 

1.19 

22154 

0.19 

46 

33 

0.39 

0.95 

-0.23 

1.05 

0.27 

0.00 

0.53 

1.05 

22155 

0.12 

45 

31 

0.37 

1.18 

1.14 

1.26 

0.87 

0.00 

0.33 

0.64 

22156 

0.62 

45 

28 

0.35 

0.72 

-2.03 

0.61 

-1.71 

0.00 

0.68 

1.60 

22157 

-1.48 

45 

40 

0.58 

0.63 

-0.86 

0.28 

-0.93 

0.00 

0.64 

1.26 

22158 

-0.38 

45 

36 

0.43 

0.93 

-0.24 

0.64 

-0.40 

0.00 

0.50 

1.14 

22159 

-1.69 

44 

42 

0.75 

0.84 

-0.07 

0.48 

-0.20 

0.00 

0.32 

1.10 

22160 

-1.36 

42 

37 

0.56 

0.87 

-0.22 

0.68 

-0.19 

0.00 

0.52 

1.10 

22161 

-0.45 

43 

34 

0.43 

1.16 

0.75 

0.79 

-0.20 

0.00 

0.42 

0.90 

22162 

-1.07 

46 

41 

0.53 

0.67 

-0.91 

0.43 

-0.82 

0.00 

0.55 

1.24 

22163 

-0.83 

45 

36 

0.46 

1.23 

0.88 

1.12 

0.40 

0.00 

0.47 

0.78 

22164 

-0.87 

45 

40 

0.56 

1.00 

0.13 

0.66 

-0.29 

0.00 

0.47 

1.05 

22165 

1.23 

44 

23 

0.35 

0.99 

0.01 

1.06 

0.37 

0.00 

0.48 

0.97 

22166 

0.60 

46 

27 

0.35 

0.65 

-2.63 

0.54 

-2.07 

0.00 

0.71 

1.76 

22167 

-0.45 

45 

34 

0.43 

0.87 

-0.51 

1.57 

1.09 

0.00 

0.55 

1.06 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22168 

-0.42 

46 

37 

0.41 

0.78 

-1.02 

0.66 

-0.67 

0.00 

0.53 

1.27 

22169 

1.97 

44 

16 

0.38 

1.13 

0.75 

1.04 

0.22 

0.00 

0.51 

0.82 

22170 

-0.03 

45 

32 

0.38 

0.89 

-0.59 

0.65 

-0.60 

0.00 

0.56 

1.25 

22171 

0.95 

45 

26 

0.36 

1.11 

0.75 

1.07 

0.34 

0.00 

0.47 

0.80 

22172 

-0.45 

46 

36 

0.41 

0.61 

-2.08 

0.41 

-1.59 

0.00 

0.61 

1.54 

22173 

-1.25 

45 

40 

0.53 

0.98 

0.07 

1.21 

0.51 

0.00 

0.34 

0.97 

22174 

0.43 

46 

30 

0.35 

0.72 

-2.11 

0.60 

-1.56 

0.00 

0.63 

1.64 

22175 

-1.27 

45 

41 

0.57 

0.87 

-0.23 

0.58 

-0.26 

0.00 

0.41 

1.11 

22176 

1.32 

46 

24 

0.37 

0.85 

-0.93 

0.79 

-0.62 

0.00 

0.64 

1.30 

22177 

-1.10 

43 

37 

0.49 

1.32 

1.13 

1.44 

0.76 

0.00 

0.22 

0.64 

22178 

-0.74 

45 

37 

0.44 

0.95 

-0.15 

0.81 

-0.14 

0.00 

0.42 

1.06 

22179 

0.05 

45 

35 

0.41 

0.81 

-0.85 

0.75 

-0.44 

0.00 

0.52 

1.22 

22180 

0.88 

46 

29 

0.36 

1.17 

1.18 

1.29 

1.07 

0.00 

0.40 

0.57 

22181 

1.56 

45 

22 

0.34 

1.01 

0.10 

0.97 

-0.07 

0.00 

0.47 

1.00 

22182 

1.26 

45 

22 

0.34 

0.77 

-1.73 

0.65 

-1.78 

0.00 

0.67 

1.57 

22183 

0.35 

2521 

1723 

0.05 

0.96 

-1.57 

0.91 

-2.07 

0.00 

0.51 

1.07 

22184 

1.06 

44 

26 

0.36 

1.16 

1.04 

1.21 

0.86 

0.00 

0.40 

0.66 

22185 

-1.37 

45 

39 

0.49 

0.92 

-0.17 

2.14 

1.52 

0.00 

0.37 

0.92 

22186 

0.29 

45 

33 

0.41 

1.06 

0.33 

0.93 

-0.03 

0.00 

0.54 

0.96 

22187 

0.47 

205 

143 

0.17 

1.03 

0.45 

0.96 

-0.26 

0.00 

0.39 

0.96 

22188 

1.09 

45 

27 

0.36 

1.10 

0.75 

1.09 

0.39 

0.00 

0.44 

0.76 

22189 

-0.64 

45 

37 

0.44 

1.02 

0.16 

1.07 

0.30 

0.00 

0.39 

0.96 

22190 

1.75 

44 

23 

0.36 

0.79 

-1.38 

0.65 

-1.27 

0.00 

0.64 

1.48 

22191 

1.16 

45 

27 

0.38 

0.99 

-0.02 

1.36 

1.19 

0.00 

0.56 

0.94 

22192 

0.64 

45 

28 

0.36 

1.07 

0.49 

1.41 

1.47 

0.00 

0.43 

0.74 

22193 

0.92 

56 

32 

0.31 

0.94 

-0.52 

0.91 

-0.47 

0.00 

0.51 

1.19 

22194 

0.29 

44 

31 

0.39 

1.20 

1.04 

1.17 

0.57 

0.00 

0.41 

0.72 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22195 

-0.02 

45 

34 

0.39 

0.89 

-0.54 

0.83 

-0.34 

0.00 

0.48 

1.18 

22196 

-0.49 

45 

37 

0.43 

0.82 

-0.75 

0.69 

-0.35 

0.00 

0.45 

1.21 

22197 

-0.64 

45 

37 

0.45 

1.10 

0.46 

1.25 

0.61 

0.00 

0.36 

0.86 

22198 

1.20 

44 

25 

0.36 

0.89 

-0.71 

0.80 

-0.91 

0.00 

0.58 

1.29 

22199 

-1.03 

45 

39 

0.48 

1.06 

0.29 

1.12 

0.41 

0.00 

0.31 

0.92 

22200 

-0.67 

45 

36 

0.42 

1.02 

0.15 

1.07 

0.30 

0.00 

0.40 

0.96 

22201 

-0.75 

44 

37 

0.50 

1.27 

0.94 

1.11 

0.38 

0.00 

0.38 

0.78 

22202 

1.60 

45 

21 

0.36 

1.20 

1.25 

1.36 

1.32 

0.00 

0.44 

0.57 

22203 

1.37 

45 

22 

0.34 

1.18 

1.33 

1.35 

1.65 

0.00 

0.33 

0.44 

22204 

-0.03 

45 

32 

0.37 

0.91 

-0.47 

0.77 

-0.57 

0.00 

0.52 

1.18 

22205 

1.41 

45 

25 

0.37 

1.00 

0.07 

0.99 

0.06 

0.00 

0.56 

0.99 

22206 

1.07 

42 

23 

0.37 

0.96 

-0.23 

0.90 

-0.32 

0.00 

0.56 

1.11 

22207 

0.83 

45 

27 

0.36 

0.75 

-1.76 

0.61 

-1.61 

0.00 

0.66 

1.55 

22208 

0.39 

45 

31 

0.37 

1.08 

0.52 

1.07 

0.34 

0.00 

0.44 

0.86 

22209 

-0.10 

43 

33 

0.42 

1.04 

0.24 

0.77 

-0.48 

0.00 

0.52 

1.03 

22210 

1.97 

45 

17 

0.35 

1.02 

0.20 

1.03 

0.23 

0.00 

0.44 

0.94 

22211 

1.98 

47 

21 

0.35 

0.94 

-0.40 

1.00 

0.10 

0.00 

0.57 

1.09 

22212 

1.01 

45 

27 

0.35 

0.78 

-1.87 

0.67 

-1.53 

0.00 

0.60 

1.68 

22213 

0.31 

47 

30 

0.36 

0.90 

-0.58 

0.73 

-0.88 

0.00 

0.59 

1.24 

22214 

1.35 

44 

25 

0.34 

1.12 

0.98 

1.12 

0.68 

0.00 

0.36 

0.65 

22215 

0.35 

43 

29 

0.38 

0.97 

-0.15 

1.12 

0.48 

0.00 

0.48 

0.99 

22216 

0.84 

45 

28 

0.35 

0.83 

-1.24 

0.75 

-0.89 

0.00 

0.57 

1.41 

22217 

0.95 

46 

26 

0.35 

0.92 

-0.49 

0.80 

-0.81 

0.00 

0.57 

1.21 

22218 

1.64 

46 

20 

0.35 

0.95 

-0.27 

1.08 

0.39 

0.00 

0.53 

1.02 

22219 

1.93 

46 

19 

0.36 

0.88 

-0.77 

0.83 

-0.53 

0.00 

0.57 

1.24 

22220 

2.36 

54 

17 

0.35 

1.13 

0.80 

1.32 

0.78 

0.00 

0.43 

0.72 

22221 

-0.03 

45 

32 

0.38 

1.25 

1.31 

1.71 

1.75 

0.00 

0.27 

0.52 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22222 

0.23 

188 

141 

0.19 

0.92 

-0.86 

0.78 

-1.10 

0.00 

0.48 

1.14 

22223 

1.74 

44 

22 

0.36 

1.05 

0.41 

4.03 

5.18 

0.00 

0.43 

0.46 

22224 

0.47 

45 

32 

0.40 

1.12 

0.68 

1.12 

0.42 

0.00 

0.48 

0.82 

22225 

0.08 

44 

31 

0.37 

1.09 

0.54 

0.99 

0.07 

0.00 

0.39 

0.89 

22226 

2.63 

45 

15 

0.39 

1.41 

1.87 

3.82 

4.32 

0.00 

0.28 

0.12 

22227 

3.62 

45 

6 

0.48 

1.20 

0.77 

5.46 

3.18 

0.00 

0.06 

0.49 

22228 

2.17 

66 

26 

0.30 

1.44 

2.94 

2.01 

3.15 

0.00 

0.28 

0.00 

22229 

0.05 

45 

31 

0.39 

1.07 

0.43 

1.12 

0.41 

0.00 

0.49 

0.87 

22230 

0.57 

202 

146 

0.18 

1.02 

0.29 

1.03 

0.22 

0.00 

0.40 

0.96 

22231 

2.30 

44 

16 

0.38 

1.46 

2.28 

2.16 

2.75 

0.00 

0.26 

0.14 

22232 

2.51 

46 

14 

0.38 

1.08 

0.47 

2.78 

2.88 

0.00 

0.40 

0.60 

22233 

-0.26 

45 

34 

0.39 

0.66 

-1.84 

0.54 

-1.37 

0.00 

0.64 

1.46 

22234 

-0.30 

204 

168 

0.20 

0.97 

-0.20 

0.74 

-0.95 

0.00 

0.42 

1.07 

22235 

1.69 

45 

15 

0.35 

0.84 

-1.12 

0.72 

-0.95 

0.00 

0.54 

1.38 

22236 

0.05 

44 

32 

0.42 

0.87 

-0.57 

0.75 

-0.49 

0.00 

0.59 

1.19 

22237 

0.01 

45 

31 

0.36 

0.98 

-0.09 

1.02 

0.17 

0.00 

0.44 

1.02 

22238 

0.83 

46 

26 

0.36 

1.14 

0.87 

1.32 

1.18 

0.00 

0.47 

0.66 

22239 

2.40 

46 

18 

0.36 

0.98 

-0.05 

0.98 

0.08 

0.00 

0.54 

1.02 

22240 

2.35 

45 

16 

0.38 

1.11 

0.71 

1.00 

0.12 

0.00 

0.52 

0.83 

22241 

2.13 

44 

15 

0.37 

1.03 

0.20 

0.98 

0.07 

0.00 

0.49 

0.95 

22242 

2.26 

45 

15 

0.40 

1.21 

1.09 

1.29 

0.75 

0.00 

0.47 

0.65 

22243 

2.27 

46 

18 

0.35 

1.11 

0.81 

1.11 

0.51 

0.00 

0.41 

0.74 

22244 

2.06 

44 

18 

0.36 

1.50 

2.80 

2.23 

3.07 

0.00 

0.20 

-0.22 

22245 

2.03 

44 

17 

0.39 

1.40 

1.91 

1.62 

1.56 

0.00 

0.42 

0.34 

22246 

2.59 

45 

14 

0.40 

1.01 

0.10 

0.89 

-0.10 

0.00 

0.59 

1.02 

22247 

1.41 

45 

26 

0.35 

1.02 

0.19 

1.18 

0.88 

0.00 

0.47 

0.90 

22248 

1.28 

46 

21 

0.34 

1.06 

0.44 

1.23 

1.18 

0.00 

0.42 

0.79 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22249 

0.19 

45 

31 

0.36 

0.83 

-1.02 

0.77 

-0.87 

0.00 

0.53 

1.33 

22250 

0.39 

46 

30 

0.35 

1.03 

0.23 

1.16 

0.61 

0.00 

0.42 

0.88 

22251 

-0.59 

45 

36 

0.42 

0.89 

-0.40 

0.63 

-0.54 

0.00 

0.50 

1.17 

22252 

1.74 

46 

18 

0.34 

0.93 

-0.49 

0.89 

-0.41 

0.00 

0.52 

1.17 

22253 

1.83 

45 

17 

0.37 

1.24 

1.38 

1.64 

1.89 

0.00 

0.38 

0.46 

22254 

0.54 

45 

31 

0.36 

0.81 

-1.20 

0.65 

-1.30 

0.00 

0.58 

1.41 

22255 

-0.20 

46 

36 

0.39 

0.87 

-0.62 

0.75 

-0.40 

0.00 

0.44 

1.20 

22256 

0.58 

44 

30 

0.35 

1.20 

1.29 

2.04 

3.20 

0.00 

0.14 

0.31 

22257 

-0.20 

45 

35 

0.41 

0.84 

-0.71 

0.62 

-0.85 

0.00 

0.56 

1.24 

22258 

0.15 

45 

33 

0.40 

0.71 

-1.52 

0.52 

-1.28 

0.00 

0.66 

1.42 

22259 

0.08 

45 

33 

0.39 

0.72 

-1.57 

0.54 

-1.31 

0.00 

0.62 

1.44 

22260 

-0.69 

46 

37 

0.41 

0.95 

-0.14 

0.88 

-0.01 

0.00 

0.41 

1.06 

22261 

-0.39 

45 

37 

0.45 

0.79 

-0.83 

0.49 

-0.61 

0.00 

0.55 

1.28 

22262 

-0.35 

46 

35 

0.39 

0.88 

-0.56 

0.81 

-0.35 

0.00 

0.51 

1.16 

22263 

0.92 

45 

28 

0.38 

0.77 

-1.22 

0.79 

-0.76 

0.00 

0.68 

1.33 

22264 

-0.43 

45 

35 

0.42 

0.89 

-0.44 

0.93 

0.04 

0.00 

0.50 

1.08 

22265 

0.18 

46 

30 

0.36 

0.75 

-1.60 

0.67 

-1.26 

0.00 

0.61 

1.45 

22266 

-1.04 

45 

38 

0.46 

0.88 

-0.37 

0.80 

-0.13 

0.00 

0.48 

1.10 

22267 

0.04 

45 

34 

0.39 

1.03 

0.20 

1.29 

0.88 

0.00 

0.41 

0.91 

22268 

1.89 

46 

20 

0.35 

1.17 

1.10 

1.18 

0.65 

0.00 

0.42 

0.65 

22269 

2.30 

46 

16 

0.37 

1.17 

0.97 

1.07 

0.33 

0.00 

0.47 

0.77 

22270 

-0.27 

51 

43 

0.42 

0.96 

-0.09 

0.98 

0.10 

0.00 

0.36 

1.04 

22271 

1.07 

45 

26 

0.36 

1.02 

0.16 

1.29 

0.98 

0.00 

0.51 

0.88 

22272 

0.54 

43 

30 

0.39 

1.02 

0.16 

1.35 

0.93 

0.00 

0.45 

0.90 

22273 

-0.62 

47 

36 

0.40 

1.33 

1.42 

2.17 

1.77 

0.00 

0.26 

0.52 

22274 

0.76 

45 

26 

0.35 

1.17 

1.18 

1.10 

0.47 

0.00 

0.39 

0.65 

22275 

0.11 

45 

31 

0.39 

0.81 

-0.99 

0.93 

-0.06 

0.00 

0.63 

1.21 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22276 

1.18 

45 

24 

0.36 

1.17 

1.09 

1.21 

0.87 

0.00 

0.45 

0.65 

22277 

2.43 

45 

14 

0.38 

0.87 

-0.71 

0.66 

-1.11 

0.00 

0.62 

1.27 

22278 

1.73 

42 

21 

0.37 

1.18 

1.23 

1.05 

0.26 

0.00 

0.48 

0.65 

22279 

0.02 

45 

33 

0.38 

0.98 

-0.05 

0.85 

-0.33 

0.00 

0.46 

1.06 

22280 

-0.13 

202 

154 

0.18 

1.00 

-0.02 

1.01 

0.13 

0.00 

0.38 

0.99 

22281 

-0.08 

214 

170 

0.19 

0.95 

-0.43 

0.91 

-0.38 

0.00 

0.45 

1.06 

22282 

1.22 

46 

24 

0.33 

1.16 

1.23 

1.11 

0.65 

0.00 

0.32 

0.60 

22283 

0.51 

44 

28 

0.38 

0.91 

-0.46 

0.77 

-0.71 

0.00 

0.59 

1.19 

22284 

0.17 

45 

32 

0.36 

0.97 

-0.13 

0.86 

-0.46 

0.00 

0.43 

1.09 

22285 

2.10 

43 

17 

0.36 

1.15 

0.97 

1.68 

2.42 

0.00 

0.31 

0.52 

22286 

0.93 

45 

25 

0.34 

1.04 

0.31 

1.12 

0.63 

0.00 

0.45 

0.91 

22287 

0.46 

45 

29 

0.37 

1.62 

3.03 

3.17 

3.96 

0.00 

0.11 

-0.29 

22288 

0.55 

46 

29 

0.37 

1.23 

1.33 

1.27 

0.77 

0.00 

0.42 

0.60 

22289 

1.29 

45 

23 

0.34 

1.19 

1.50 

1.29 

1.33 

0.00 

0.32 

0.39 

22290 

0.31 

45 

31 

0.37 

1.01 

0.10 

1.14 

0.56 

0.00 

0.45 

0.94 

22291 

-0.43 

44 

35 

0.43 

0.94 

-0.18 

0.77 

-0.33 

0.00 

0.48 

1.10 

22292 

3.30 

46 

8 

0.44 

0.95 

-0.10 

0.73 

-0.26 

0.00 

0.47 

1.08 

22293 

0.22 

44 

28 

0.39 

0.73 

-1.47 

0.55 

-1.44 

0.00 

0.71 

1.42 

22294 

-0.47 

44 

37 

0.44 

0.89 

-0.36 

0.65 

-0.66 

0.00 

0.41 

1.16 

22295 

-0.54 

48 

40 

0.43 

0.77 

-0.94 

0.64 

-0.71 

0.00 

0.53 

1.23 

22296 

1.16 

46 

24 

0.36 

1.13 

0.79 

1.37 

1.34 

0.00 

0.49 

0.71 

22297 

1.04 

46 

25 

0.35 

0.84 

-1.06 

0.84 

-0.57 

0.00 

0.61 

1.29 

22298 

2.06 

45 

19 

0.38 

1.38 

1.99 

3.05 

3.59 

0.00 

0.35 

0.10 

22299 

1.79 

45 

19 

0.36 

0.79 

-1.39 

0.64 

-1.22 

0.00 

0.66 

1.44 

22300 

-0.22 

45 

34 

0.41 

0.83 

-0.73 

0.62 

-0.57 

0.00 

0.58 

1.24 

22301 

-0.04 

45 

36 

0.40 

0.87 

-0.58 

0.64 

-0.92 

0.00 

0.44 

1.24 

22302 

-0.07 

44 

32 

0.37 

0.78 

-1.39 

0.65 

-1.03 

0.00 

0.53 

1.43 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22303 

0.30 

43 

29 

0.38 

1.07 

0.48 

1.22 

0.75 

0.00 

0.44 

0.81 

22304 

0.54 

45 

27 

0.38 

1.02 

0.17 

1.14 

0.45 

0.00 

0.57 

0.92 

22305 

0.26 

46 

34 

0.38 

0.87 

-0.61 

0.66 

-1.09 

0.00 

0.57 

1.24 

22306 

0.95 

44 

26 

0.35 

1.05 

0.37 

1.02 

0.15 

0.00 

0.46 

0.91 

22307 

1.38 

45 

22 

0.35 

1.59 

3.25 

1.76 

2.73 

0.00 

0.17 

-0.21 

22308 

0.62 

46 

26 

0.36 

1.03 

0.25 

1.00 

0.08 

0.00 

0.54 

0.96 

22309 

1.80 

46 

18 

0.37 

1.23 

1.28 

1.53 

1.72 

0.00 

0.45 

0.59 

22310 

0.61 

45 

28 

0.35 

0.97 

-0.18 

0.93 

-0.19 

0.00 

0.46 

1.08 

22311 

2.14 

44 

15 

0.37 

1.20 

1.18 

1.60 

1.89 

0.00 

0.33 

0.54 

22312 

0.40 

45 

32 

0.37 

1.19 

1.09 

1.34 

0.91 

0.00 

0.31 

0.63 

22313 

1.44 

44 

17 

0.35 

0.78 

-1.50 

0.68 

-1.41 

0.00 

0.64 

1.47 

22314 

1.71 

44 

20 

0.34 

0.88 

-0.92 

0.82 

-0.77 

0.00 

0.56 

1.32 

22315 

-0.98 

45 

38 

0.52 

1.07 

0.33 

0.65 

-0.18 

0.00 

0.55 

1.00 

22316 

1.56 

45 

24 

0.37 

1.01 

0.09 

1.01 

0.13 

0.00 

0.57 

0.98 

22317 

1.33 

45 

23 

0.36 

1.29 

1.79 

1.34 

1.30 

0.00 

0.38 

0.38 

22318 

0.37 

45 

32 

0.38 

1.02 

0.18 

1.04 

0.24 

0.00 

0.47 

0.97 

22319 

1.32 

45 

22 

0.35 

1.23 

1.64 

1.91 

2.74 

0.00 

0.31 

0.19 

22320 

1.81 

44 

19 

0.36 

1.20 

1.23 

1.26 

0.99 

0.00 

0.42 

0.57 

22321 

1.27 

45 

24 

0.35 

1.22 

1.61 

1.40 

1.65 

0.00 

0.40 

0.33 

22322 

1.15 

44 

20 

0.35 

1.07 

0.58 

1.09 

0.36 

0.00 

0.42 

0.79 

22323 

1.57 

45 

24 

0.36 

1.02 

0.21 

0.99 

0.07 

0.00 

0.52 

0.96 

22324 

1.87 

45 

20 

0.35 

1.17 

1.07 

1.27 

1.02 

0.00 

0.41 

0.61 

22325 

1.18 

44 

25 

0.35 

0.85 

-1.14 

0.88 

-0.48 

0.00 

0.57 

1.34 

22326 

1.05 

50 

28 

0.32 

1.18 

1.46 

1.44 

1.63 

0.00 

0.30 

0.39 

22327 

0.62 

198 

134 

0.17 

0.95 

-0.72 

0.91 

-0.55 

0.00 

0.47 

1.10 

22328 

0.54 

45 

29 

0.36 

0.86 

-0.92 

1.18 

0.71 

0.00 

0.53 

1.21 

22329 

0.06 

45 

31 

0.37 

1.28 

1.66 

1.40 

1.09 

0.00 

0.30 

0.40 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22330 

0.96 

43 

28 

0.39 

0.83 

-0.90 

0.68 

-0.86 

0.00 

0.65 

1.32 

22331 

-0.25 

44 

34 

0.41 

0.93 

-0.25 

0.73 

-0.50 

0.00 

0.48 

1.13 

22332 

-1.25 

180 

164 

0.28 

0.97 

-0.09 

0.58 

-0.87 

0.00 

0.36 

1.06 

22333 

1.05 

47 

28 

0.35 

0.86 

-1.01 

0.73 

-1.14 

0.00 

0.60 

1.39 

22334 

0.89 

56 

33 

0.32 

0.82 

-1.41 

0.68 

-1.36 

0.00 

0.62 

1.43 

22335 

0.54 

44 

29 

0.38 

1.06 

0.37 

0.97 

0.01 

0.00 

0.49 

0.93 

22336 

0.45 

45 

28 

0.38 

0.82 

-1.00 

0.67 

-1.04 

0.00 

0.65 

1.34 

22337 

1.25 

45 

24 

0.37 

0.91 

-0.51 

0.77 

-0.83 

0.00 

0.63 

1.22 

22338 

0.60 

45 

31 

0.37 

0.80 

-1.30 

0.65 

-1.13 

0.00 

0.60 

1.44 

22339 

0.20 

49 

35 

0.36 

0.80 

-1.21 

1.09 

0.36 

0.00 

0.55 

1.26 

22340 

0.41 

44 

30 

0.39 

0.85 

-0.87 

0.72 

-0.70 

0.00 

0.59 

1.29 

22341 

1.11 

45 

24 

0.35 

0.77 

-1.80 

0.72 

-1.65 

0.00 

0.63 

1.62 

22342 

0.06 

46 

33 

0.38 

0.87 

-0.68 

0.68 

-0.96 

0.00 

0.57 

1.26 

22343 

0.58 

45 

32 

0.38 

0.78 

-1.26 

0.65 

-1.17 

0.00 

0.62 

1.37 

22344 

1.56 

44 

19 

0.35 

0.77 

-1.73 

0.71 

-1.63 

0.00 

0.61 

1.61 

22345 

-0.60 

45 

36 

0.42 

0.90 

-0.38 

0.75 

-0.40 

0.00 

0.50 

1.13 

22346 

0.88 

44 

27 

0.36 

0.77 

-1.49 

0.63 

-1.39 

0.00 

0.65 

1.47 

22347 

0.58 

45 

29 

0.36 

1.04 

0.31 

0.89 

-0.26 

0.00 

0.47 

0.98 

22348 

0.65 

45 

29 

0.35 

1.01 

0.10 

0.92 

-0.27 

0.00 

0.45 

1.02 

22349 

0.61 

45 

32 

0.37 

0.84 

-0.89 

0.72 

-0.91 

0.00 

0.55 

1.29 

22350 

0.80 

44 

26 

0.36 

1.12 

0.80 

1.09 

0.42 

0.00 

0.46 

0.75 

22351 

0.05 

198 

150 

0.18 

1.09 

1.01 

1.01 

0.12 

0.00 

0.35 

0.89 

22352 

-0.73 

48 

39 

0.41 

0.91 

-0.31 

0.71 

-0.25 

0.00 

0.44 

1.12 

22353 

-0.70 

199 

170 

0.22 

0.80 

-1.59 

0.46 

-1.93 

0.00 

0.52 

1.24 

22354 

1.46 

45 

22 

0.37 

0.80 

-1.21 

0.66 

-1.35 

0.00 

0.68 

1.39 

22355 

1.25 

43 

21 

0.36 

1.15 

1.03 

1.71 

2.42 

0.00 

0.40 

0.48 

22356 

0.86 

45 

29 

0.39 

0.96 

-0.14 

0.84 

-0.35 

0.00 

0.60 

1.08 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22357 

1.52 

45 

19 

0.35 

0.78 

-1.61 

0.65 

-1.45 

0.00 

0.64 

1.54 

22358 

0.45 

46 

32 

0.36 

0.83 

-1.01 

0.67 

-1.10 

0.00 

0.58 

1.33 

22359 

0.78 

45 

28 

0.36 

0.93 

-0.38 

0.87 

-0.46 

0.00 

0.56 

1.15 

22360 

1.29 

45 

24 

0.36 

1.23 

1.35 

1.37 

1.40 

0.00 

0.39 

0.52 

22361 

0.27 

44 

29 

0.36 

0.95 

-0.32 

0.81 

-0.43 

0.00 

0.50 

1.15 

22362 

0.07 

61 

45 

0.33 

0.71 

-1.97 

0.53 

-1.41 

0.00 

0.62 

1.47 

22363 

-0.39 

45 

36 

0.43 

0.63 

-1.58 

0.42 

-1.42 

0.00 

0.63 

1.41 

22364 

0.16 

45 

32 

0.39 

0.80 

-0.95 

0.60 

-1.12 

0.00 

0.65 

1.30 

22365 

0.08 

46 

29 

0.36 

1.22 

1.24 

1.35 

0.97 

0.00 

0.39 

0.60 

22366 

0.08 

46 

32 

0.39 

0.97 

-0.09 

0.96 

-0.02 

0.00 

0.54 

1.04 

22367 

0.97 

45 

27 

0.36 

0.86 

-0.99 

0.79 

-0.82 

0.00 

0.59 

1.35 

22368 

1.40 

45 

24 

0.36 

1.04 

0.32 

1.12 

0.54 

0.00 

0.52 

0.85 

22369 

-0.08 

43 

33 

0.40 

0.87 

-0.58 

0.71 

-0.76 

0.00 

0.55 

1.20 

22370 

0.13 

45 

32 

0.40 

0.87 

-0.54 

0.67 

-0.86 

0.00 

0.64 

1.20 

22371 

-0.86 

45 

38 

0.47 

1.14 

0.59 

1.94 

1.33 

0.00 

0.29 

0.74 

22372 

-0.97 

45 

39 

0.50 

0.89 

-0.27 

0.57 

-0.36 

0.00 

0.47 

1.13 

22373 

1.26 

46 

26 

0.33 

0.74 

-2.30 

0.65 

-1.99 

0.00 

0.65 

1.77 

22374 

0.44 

44 

30 

0.37 

0.93 

-0.35 

0.82 

-0.56 

0.00 

0.54 

1.15 

22375 

0.12 

46 

34 

0.38 

0.69 

-1.93 

0.55 

-1.07 

0.00 

0.59 

1.56 

22376 

0.06 

45 

32 

0.39 

0.81 

-0.96 

0.72 

-0.65 

0.00 

0.63 

1.26 

22377 

-0.77 

44 

35 

0.43 

0.57 

-2.12 

0.35 

-1.63 

0.00 

0.70 

1.50 

22378 

-0.64 

45 

38 

0.45 

0.80 

-0.71 

0.53 

-0.64 

0.00 

0.50 

1.23 

22379 

-0.43 

45 

35 

0.40 

0.94 

-0.23 

0.86 

-0.12 

0.00 

0.47 

1.08 

22380 

0.66 

45 

30 

0.36 

1.07 

0.48 

1.06 

0.30 

0.00 

0.40 

0.87 

22381 

-1.41 

43 

38 

0.54 

0.90 

-0.19 

0.74 

0.03 

0.00 

0.45 

1.06 

22382 

1.11 

45 

21 

0.34 

1.20 

1.37 

1.31 

1.31 

0.00 

0.33 

0.48 

22383 

0.30 

45 

32 

0.37 

0.84 

-0.88 

0.67 

-1.03 

0.00 

0.57 

1.30 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

22384 

0.11 

45 

32 

0.39 

1.26 

1.34 

1.25 

0.67 

0.00 

0.35 

0.61 

22385 

0.02 

45 

30 

0.37 

1.02 

0.17 

0.84 

-0.44 

0.00 

0.49 

1.04 

22386 

0.49 

45 

30 

0.36 

1.02 

0.17 

1.18 

0.68 

0.00 

0.43 

0.94 

22387 

1.40 

45 

23 

0.34 

0.74 

-2.17 

0.65 

-1.78 

0.00 

0.64 

1.74 

22388 

1.05 

2509 

1418 

0.05 

0.95 

-2.55 

0.92 

-2.29 

0.00 

0.55 

1.12 

22389 

0.83 

45 

29 

0.36 

0.99 

0.02 

0.96 

-0.02 

0.00 

0.50 

1.01 

22390 

1.11 

46 

23 

0.33 

0.96 

-0.31 

0.91 

-0.52 

0.00 

0.46 

1.17 

22391 

0.56 

45 

29 

0.36 

1.02 

0.20 

1.02 

0.17 

0.00 

0.46 

0.95 

22392 

1.64 

45 

22 

0.35 

1.02 

0.20 

0.97 

-0.03 

0.00 

0.52 

0.96 

22393 

0.20 

46 

30 

0.38 

0.87 

-0.71 

0.85 

-0.38 

0.00 

0.60 

1.20 

22394 

0.18 

46 

35 

0.40 

1.14 

0.74 

1.05 

0.27 

0.00 

0.40 

0.84 

22395 

1.81 

47 

20 

0.35 

0.79 

-1.51 

0.69 

-1.29 

0.00 

0.65 

1.47 

22396 

0.31 

44 

32 

0.39 

1.09 

0.51 

1.00 

0.10 

0.00 

0.44 

0.90 

22397 

1.85 

45 

19 

0.36 

1.13 

0.84 

1.95 

2.36 

0.00 

0.41 

0.59 

22398 

0.72 

45 

29 

0.36 

1.07 

0.44 

1.17 

0.73 

0.00 

0.43 

0.84 

22399 

0.21 

45 

30 

0.38 

1.25 

1.25 

1.12 

0.43 

0.00 

0.42 

0.69 

22400 

1.41 

44 

26 

0.36 

1.44 

2.39 

2.09 

3.31 

0.00 

0.21 

0.01 

23001 

-3.03 

45 

43 

0.80 

0.88 

-0.06 

0.23 

-0.36 

0.00 

0.38 

1.14 

23002 

0.00 

44 

44 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

23003 

-2.71 

44 

42 

0.88 

0.62 

-0.35 

0.15 

-0.58 

0.00 

0.58 

1.19 

23004 

-2.31 

44 

42 

0.75 

1.03 

0.25 

0.89 

0.31 

0.00 

0.20 

0.98 

23005 

-1.68 

45 

42 

0.63 

1.15 

0.46 

2.02 

1.08 

0.00 

0.12 

0.82 

23006 

-1.43 

46 

42 

0.59 

1.34 

0.88 

0.78 

0.01 

0.00 

0.27 

0.87 

23007 

-1.01 

44 

38 

0.48 

0.88 

-0.29 

0.59 

-0.56 

0.00 

0.45 

1.13 

23008 

-2.76 

45 

43 

0.76 

0.94 

0.09 

0.29 

-0.27 

0.00 

0.32 

1.10 

23009 

-1.47 

44 

39 

0.53 

1.06 

0.28 

0.87 

0.09 

0.00 

0.35 

0.96 

23010 

-2.30 

44 

42 

0.77 

0.94 

0.09 

0.42 

-0.22 

0.00 

0.33 

1.07 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23011 

-2.09 

45 

42 

0.63 

0.97 

0.08 

0.92 

0.32 

0.00 

0.28 

0.99 

23012 

-3.90 

45 

44 

1.26 

0.28 

-0.80 

0.03 

-1.02 

0.00 

0.48 

1.27 

23013 

-3.15 

45 

43 

0.97 

0.84 

0.07 

0.22 

-0.37 

0.00 

0.53 

1.11 

23014 

-2.77 

45 

44 

1.04 

1.09 

0.40 

0.87 

0.37 

0.00 

0.11 

0.94 

23015 

-2.43 

45 

43 

0.75 

0.83 

-0.11 

0.24 

-0.40 

0.00 

0.35 

1.15 

23016 

-1.69 

45 

41 

0.59 

0.76 

-0.49 

0.86 

0.16 

0.00 

0.47 

1.11 

23017 

-0.82 

46 

38 

0.42 

1.40 

1.61 

1.78 

1.63 

0.00 

-0.01 

0.46 

23018 

-0.95 

51 

46 

0.51 

1.01 

0.14 

0.70 

-0.14 

0.00 

0.35 

1.03 

23019 

-1.18 

45 

40 

0.53 

0.82 

-0.45 

0.62 

-0.34 

0.00 

0.48 

1.14 

23020 

-1.72 

45 

41 

0.55 

1.08 

0.33 

0.88 

0.16 

0.00 

0.23 

0.95 

23021 

0.10 

44 

31 

0.40 

1.66 

2.82 

1.95 

1.54 

0.00 

0.26 

-0.03 

23022 

0.39 

235 

161 

0.16 

1.16 

2.27 

1.13 

1.08 

0.00 

0.30 

0.70 

23023 

0.47 

43 

29 

0.36 

1.02 

0.22 

0.89 

-0.23 

0.00 

0.43 

1.00 

23024 

0.22 

45 

30 

0.36 

1.01 

0.10 

0.89 

-0.33 

0.00 

0.46 

1.03 

23025 

0.28 

46 

29 

0.35 

1.12 

0.82 

0.99 

0.07 

0.00 

0.43 

0.81 

23026 

0.59 

46 

30 

0.35 

0.97 

-0.15 

0.95 

-0.07 

0.00 

0.48 

1.06 

23027 

1.20 

46 

23 

0.35 

1.40 

2.52 

1.62 

2.15 

0.00 

0.28 

0.05 

23028 

0.69 

45 

28 

0.35 

1.25 

1.61 

1.23 

1.02 

0.00 

0.28 

0.47 

23029 

1.13 

45 

24 

0.36 

1.02 

0.20 

1.13 

0.56 

0.00 

0.52 

0.92 

23030 

0.66 

45 

31 

0.36 

1.08 

0.54 

1.00 

0.10 

0.00 

0.36 

0.86 

23031 

-1.98 

45 

41 

0.59 

0.95 

0.01 

0.97 

0.32 

0.00 

0.36 

0.98 

23032 

5.84 

46 

1 

1.03 

1.13 

0.45 

9.90 

2.92 

0.00 

-0.13 

0.70 

23033 

0.00 

46 

0 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

23034 

-0.43 

45 

36 

0.43 

1.00 

0.07 

1.20 

0.51 

0.00 

0.45 

0.97 

23035 

-0.40 

45 

38 

0.47 

1.25 

0.89 

1.06 

0.29 

0.00 

0.30 

0.81 

23036 

0.47 

45 

31 

0.38 

0.96 

-0.18 

0.92 

-0.11 

0.00 

0.53 

1.07 

23037 

-0.37 

45 

36 

0.43 

0.77 

-0.89 

0.55 

-0.82 

0.00 

0.59 

1.27 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23038 

-0.35 

46 

36 

0.43 

0.88 

-0.40 

1.03 

0.23 

0.00 

0.56 

1.09 

23039 

-0.14 

46 

36 

0.41 

0.91 

-0.33 

0.90 

-0.12 

0.00 

0.52 

1.09 

23040 

-1.01 

45 

40 

0.53 

1.15 

0.53 

1.29 

0.59 

0.00 

0.28 

0.87 

23041 

0.08 

44 

32 

0.40 

1.12 

0.66 

1.03 

0.21 

0.00 

0.44 

0.85 

23042 

-1.70 

44 

39 

0.56 

1.22 

0.69 

2.14 

1.19 

0.00 

0.31 

0.75 

23043 

-0.04 

45 

36 

0.41 

1.09 

0.44 

1.86 

1.76 

0.00 

0.29 

0.82 

23044 

-1.11 

46 

41 

0.52 

1.14 

0.50 

0.82 

0.03 

0.00 

0.32 

0.95 

23045 

-0.51 

44 

36 

0.44 

0.97 

-0.07 

0.79 

-0.14 

0.00 

0.42 

1.06 

23046 

-0.10 

45 

37 

0.43 

1.15 

0.67 

1.02 

0.21 

0.00 

0.32 

0.86 

23047 

-0.98 

46 

39 

0.49 

1.27 

0.89 

1.93 

1.27 

0.00 

0.38 

0.76 

23048 

-1.91 

44 

41 

0.64 

1.04 

0.24 

3.97 

2.05 

0.00 

0.07 

0.76 

23049 

-1.74 

44 

41 

0.67 

1.55 

1.09 

3.07 

1.68 

0.00 

0.03 

0.61 

23050 

-0.99 

233 

205 

0.21 

1.01 

0.14 

1.07 

0.34 

0.00 

0.26 

0.97 

23051 

0.51 

46 

32 

0.36 

1.14 

0.80 

0.97 

-0.01 

0.00 

0.39 

0.85 

23052 

0.22 

44 

36 

0.43 

0.96 

-0.08 

0.88 

-0.11 

0.00 

0.39 

1.04 

23053 

0.01 

45 

31 

0.36 

0.98 

-0.05 

0.83 

-0.44 

0.00 

0.47 

1.08 

23054 

-0.29 

45 

37 

0.42 

0.96 

-0.08 

0.71 

-0.60 

0.00 

0.39 

1.10 

23055 

-0.71 

45 

36 

0.45 

1.31 

1.21 

1.35 

0.72 

0.00 

0.37 

0.67 

23056 

-0.17 

45 

34 

0.39 

1.00 

0.08 

0.97 

0.06 

0.00 

0.38 

1.00 

23057 

-0.53 

44 

36 

0.44 

0.72 

-1.12 

0.64 

-0.62 

0.00 

0.61 

1.27 

23058 

-0.19 

44 

32 

0.41 

1.07 

0.41 

1.20 

0.61 

0.00 

0.48 

0.88 

23059 

0.34 

46 

31 

0.38 

1.21 

1.10 

1.18 

0.60 

0.00 

0.42 

0.70 

23060 

0.21 

44 

30 

0.37 

1.12 

0.76 

1.24 

0.74 

0.00 

0.40 

0.75 

23061 

-0.11 

46 

36 

0.41 

1.03 

0.22 

0.86 

-0.17 

0.00 

0.45 

0.99 

23062 

-0.34 

45 

35 

0.41 

1.16 

0.73 

1.45 

1.07 

0.00 

0.33 

0.73 

23063 

-0.56 

45 

35 

0.42 

0.98 

-0.01 

0.80 

-0.30 

0.00 

0.50 

1.05 

23064 

0.37 

46 

34 

0.38 

1.20 

1.05 

1.59 

1.74 

0.00 

0.30 

0.63 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23065 

-0.08 

45 

34 

0.39 

0.93 

-0.28 

0.76 

-0.64 

0.00 

0.45 

1.15 

23066 

0.23 

46 

34 

0.40 

1.33 

1.48 

1.21 

0.63 

0.00 

0.36 

0.63 

23067 

1.09 

44 

24 

0.36 

1.35 

1.94 

1.32 

1.15 

0.00 

0.37 

0.39 

23068 

0.32 

45 

27 

0.37 

1.33 

1.68 

1.42 

1.49 

0.00 

0.36 

0.46 

23069 

-0.43 

44 

36 

0.46 

1.22 

0.82 

1.18 

0.48 

0.00 

0.36 

0.77 

23070 

-0.11 

44 

34 

0.40 

1.11 

0.59 

0.95 

0.09 

0.00 

0.35 

0.87 

23071 

0.16 

44 

30 

0.37 

1.08 

0.55 

1.07 

0.30 

0.00 

0.41 

0.84 

23072 

0.08 

44 

31 

0.37 

0.88 

-0.65 

0.71 

-0.80 

0.00 

0.54 

1.25 

23073 

-0.19 

46 

36 

0.40 

1.07 

0.40 

0.99 

0.12 

0.00 

0.39 

0.92 

23074 

0.04 

45 

32 

0.37 

1.05 

0.33 

0.92 

-0.10 

0.00 

0.43 

0.96 

23075 

-1.09 

45 

40 

0.54 

1.45 

1.22 

1.12 

0.41 

0.00 

0.21 

0.72 

23076 

0.27 

44 

29 

0.36 

1.06 

0.40 

1.09 

0.44 

0.00 

0.41 

0.87 

23077 

0.90 

42 

26 

0.37 

1.23 

1.45 

1.49 

1.51 

0.00 

0.36 

0.39 

23078 

0.99 

45 

27 

0.35 

1.19 

1.25 

1.13 

0.49 

0.00 

0.39 

0.63 

23079 

1.06 

46 

23 

0.35 

1.17 

1.15 

1.19 

0.85 

0.00 

0.41 

0.63 

23080 

1.28 

45 

23 

0.33 

1.27 

2.11 

1.46 

2.29 

0.00 

0.22 

0.08 

23081 

1.60 

46 

25 

0.34 

1.05 

0.42 

0.97 

-0.06 

0.00 

0.48 

0.92 

23082 

1.17 

46 

30 

0.35 

1.04 

0.29 

1.02 

0.17 

0.00 

0.42 

0.91 

23083 

0.69 

44 

27 

0.36 

1.41 

2.33 

1.51 

1.86 

0.00 

0.21 

0.16 

23084 

-0.01 

44 

32 

0.41 

1.13 

0.67 

2.51 

2.47 

0.00 

0.39 

0.60 

23085 

0.56 

46 

33 

0.37 

1.00 

0.05 

0.95 

-0.04 

0.00 

0.48 

1.02 

23086 

0.68 

45 

30 

0.36 

1.38 

2.41 

1.60 

1.91 

0.00 

0.19 

0.01 

23087 

0.20 

46 

34 

0.40 

1.16 

0.81 

1.15 

0.48 

0.00 

0.44 

0.81 

23088 

0.37 

46 

31 

0.35 

0.98 

-0.06 

0.92 

-0.20 

0.00 

0.44 

1.06 

23089 

1.19 

44 

25 

0.35 

1.02 

0.20 

0.93 

-0.23 

0.00 

0.47 

0.99 

23090 

0.43 

45 

29 

0.35 

1.21 

1.34 

1.22 

0.97 

0.00 

0.31 

0.55 

23091 

0.59 

45 

28 

0.38 

0.99 

-0.01 

0.80 

-0.43 

0.00 

0.57 

1.08 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23092 

1.47 

43 

21 

0.37 

1.37 

2.10 

1.60 

1.92 

0.00 

0.32 

0.20 

23093 

0.49 

44 

26 

0.36 

1.31 

1.87 

1.99 

2.89 

0.00 

0.29 

0.24 

23094 

0.65 

45 

28 

0.37 

1.13 

0.77 

1.25 

0.94 

0.00 

0.45 

0.75 

23095 

1.20 

45 

25 

0.36 

1.32 

2.05 

1.51 

1.96 

0.00 

0.37 

0.14 

23096 

0.71 

43 

29 

0.36 

1.14 

0.86 

1.15 

0.56 

0.00 

0.34 

0.73 

23097 

0.30 

45 

33 

0.38 

1.37 

1.95 

1.47 

1.18 

0.00 

0.25 

0.36 

23098 

0.75 

45 

28 

0.36 

0.98 

-0.06 

0.90 

-0.26 

0.00 

0.51 

1.05 

23099 

1.58 

45 

20 

0.37 

1.29 

1.65 

1.50 

1.64 

0.00 

0.44 

0.41 

23100 

0.81 

44 

27 

0.35 

1.29 

1.75 

1.49 

1.91 

0.00 

0.25 

0.38 

23101 

-0.25 

43 

33 

0.41 

1.00 

0.05 

0.82 

-0.28 

0.00 

0.45 

1.04 

23102 

0.96 

46 

28 

0.36 

1.14 

0.86 

1.13 

0.55 

0.00 

0.45 

0.74 

23103 

-0.47 

45 

36 

0.42 

0.88 

-0.46 

0.61 

-0.82 

0.00 

0.51 

1.20 

23104 

-1.01 

45 

40 

0.54 

1.45 

1.23 

2.23 

1.34 

0.00 

0.16 

0.60 

23105 

-0.17 

46 

36 

0.41 

0.96 

-0.13 

0.93 

-0.01 

0.00 

0.45 

1.04 

23106 

-1.20 

46 

40 

0.52 

1.19 

0.66 

0.85 

0.06 

0.00 

0.44 

0.89 

23107 

-1.50 

43 

39 

0.58 

1.10 

0.38 

2.12 

1.19 

0.00 

0.25 

0.83 

23108 

-1.80 

45 

42 

0.63 

0.93 

-0.01 

0.56 

-0.11 

0.00 

0.31 

1.07 

23109 

-0.18 

45 

34 

0.41 

1.33 

1.47 

1.12 

0.40 

0.00 

0.35 

0.66 

23110 

-0.47 

46 

38 

0.43 

0.87 

-0.41 

0.75 

-0.38 

0.00 

0.49 

1.13 

23111 

-1.10 

45 

39 

0.48 

1.03 

0.19 

0.77 

-0.13 

0.00 

0.36 

1.02 

23112 

-0.47 

45 

36 

0.42 

0.92 

-0.26 

0.80 

-0.16 

0.00 

0.47 

1.10 

23113 

0.56 

45 

31 

0.37 

0.97 

-0.11 

0.90 

-0.21 

0.00 

0.50 

1.06 

23114 

0.85 

44 

28 

0.39 

1.39 

1.92 

1.52 

1.43 

0.00 

0.41 

0.39 

23115 

0.30 

44 

30 

0.37 

0.88 

-0.67 

0.74 

-0.82 

0.00 

0.54 

1.26 

23116 

1.01 

45 

26 

0.37 

1.32 

1.75 

1.48 

1.60 

0.00 

0.40 

0.37 

23117 

-0.63 

45 

36 

0.42 

1.42 

1.82 

2.15 

1.79 

0.00 

0.16 

0.32 

23118 

1.36 

45 

23 

0.36 

1.13 

0.96 

1.20 

0.98 

0.00 

0.46 

0.62 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23119 

0.37 

44 

30 

0.38 

0.84 

-0.88 

0.66 

-0.78 

0.00 

0.60 

1.31 

23120 

-0.40 

46 

33 

0.38 

1.06 

0.40 

0.96 

0.08 

0.00 

0.46 

0.92 

23121 

-1.50 

45 

41 

0.56 

1.27 

0.77 

1.39 

0.69 

0.00 

0.14 

0.78 

23122 

-0.79 

46 

38 

0.45 

1.03 

0.20 

0.73 

-0.23 

0.00 

0.45 

1.03 

23123 

-0.96 

46 

40 

0.47 

1.03 

0.19 

0.94 

0.14 

0.00 

0.30 

0.98 

23124 

1.51 

49 

23 

0.33 

1.82 

4.94 

2.20 

3.91 

0.00 

-0.02 

-1.07 

23125 

1.98 

45 

17 

0.36 

1.52 

3.02 

2.81 

4.21 

0.00 

0.10 

-0.40 

23126 

4.02 

43 

4 

0.55 

1.33 

0.89 

4.59 

2.81 

0.00 

-0.24 

0.55 

23127 

-1.29 

46 

41 

0.50 

1.11 

0.43 

0.91 

0.15 

0.00 

0.24 

0.93 

23128 

-0.03 

45 

35 

0.39 

1.39 

1.79 

1.72 

1.50 

0.00 

0.07 

0.36 

23129 

0.16 

44 

33 

0.40 

1.18 

0.92 

1.03 

0.22 

0.00 

0.38 

0.79 

23130 

1.18 

45 

22 

0.37 

1.20 

1.20 

1.40 

1.27 

0.00 

0.46 

0.57 

23131 

-1.60 

44 

40 

0.56 

0.96 

0.03 

0.67 

-0.04 

0.00 

0.32 

1.06 

23132 

-1.72 

45 

40 

0.53 

0.89 

-0.21 

0.57 

-0.27 

0.00 

0.42 

1.10 

23133 

-0.17 

44 

31 

0.39 

1.07 

0.43 

1.05 

0.27 

0.00 

0.45 

0.88 

23134 

-1.18 

45 

38 

0.48 

0.94 

-0.12 

0.60 

-0.39 

0.00 

0.52 

1.10 

23135 

-0.81 

45 

37 

0.44 

0.94 

-0.18 

0.95 

0.13 

0.00 

0.41 

1.04 

23136 

-2.09 

44 

41 

0.66 

1.07 

0.31 

0.43 

-0.27 

0.00 

0.38 

1.04 

23137 

2.41 

46 

15 

0.37 

1.25 

1.49 

1.25 

0.73 

0.00 

0.36 

0.55 

23138 

2.98 

44 

11 

0.41 

0.95 

-0.17 

0.75 

-0.39 

0.00 

0.53 

1.11 

23139 

0.38 

45 

30 

0.36 

0.97 

-0.10 

0.95 

-0.06 

0.00 

0.48 

1.04 

23140 

-0.37 

45 

34 

0.39 

1.19 

1.02 

1.02 

0.18 

0.00 

0.34 

0.77 

23141 

-1.37 

43 

39 

0.56 

0.95 

-0.01 

0.60 

-0.17 

0.00 

0.33 

1.07 

23142 

-0.61 

45 

38 

0.46 

1.03 

0.22 

0.62 

-0.59 

0.00 

0.41 

1.06 

23143 

-0.25 

44 

35 

0.43 

0.97 

-0.07 

0.93 

-0.05 

0.00 

0.46 

1.04 

23144 

0.77 

46 

29 

0.36 

1.15 

1.01 

1.19 

0.64 

0.00 

0.44 

0.63 

23145 

-0.28 

46 

36 

0.41 

1.37 

1.67 

2.05 

2.06 

0.00 

0.22 

0.35 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23146 

2.39 

45 

13 

0.36 

1.50 

2.69 

2.13 

2.57 

0.00 

-0.03 

-0.08 

23147 

-0.72 

45 

38 

0.45 

1.06 

0.31 

0.93 

0.10 

0.00 

0.32 

0.95 

23148 

-0.68 

203 

175 

0.23 

1.08 

0.63 

1.19 

0.67 

0.00 

0.33 

0.92 

23149 

-1.45 

44 

41 

0.66 

0.71 

-0.55 

0.22 

-0.64 

0.00 

0.50 

1.23 

23150 

1.05 

45 

27 

0.36 

1.36 

1.91 

1.38 

1.49 

0.00 

0.35 

0.39 

23151 

-3.33 

45 

44 

1.03 

1.05 

0.36 

0.77 

0.30 

0.00 

0.12 

0.97 

23152 

-3.62 

47 

46 

1.06 

0.82 

0.07 

0.11 

-0.62 

0.00 

0.35 

1.14 

23153 

-2.57 

45 

43 

0.83 

0.63 

-0.47 

0.15 

-0.56 

0.00 

0.47 

1.21 

23154 

-2.92 

45 

43 

0.85 

0.71 

-0.23 

0.25 

-0.44 

0.00 

0.48 

1.15 

23155 

-2.64 

45 

43 

0.78 

0.84 

-0.09 

0.24 

-0.42 

0.00 

0.39 

1.14 

23156 

-2.44 

45 

43 

0.75 

1.03 

0.25 

0.78 

0.21 

0.00 

0.20 

0.99 

23157 

-1.53 

184 

173 

0.34 

0.92 

-0.24 

1.21 

0.54 

0.00 

0.33 

1.03 

23158 

-0.53 

45 

37 

0.44 

0.77 

-0.94 

0.61 

-0.63 

0.00 

0.52 

1.27 

23159 

-1.59 

45 

41 

0.55 

0.80 

-0.43 

0.42 

-0.46 

0.00 

0.42 

1.18 

23160 

-2.17 

45 

42 

0.64 

1.29 

0.72 

1.03 

0.38 

0.00 

0.16 

0.84 

23161 

-1.72 

46 

41 

0.59 

0.80 

-0.42 

0.34 

-0.56 

0.00 

0.59 

1.19 

23162 

0.00 

45 

45 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

23163 

-0.59 

45 

36 

0.43 

1.03 

0.21 

0.73 

-0.33 

0.00 

0.45 

1.03 

23164 

2.14 

45 

20 

0.36 

1.18 

1.18 

1.18 

0.84 

0.00 

0.44 

0.61 

23165 

-1.47 

214 

199 

0.28 

1.02 

0.15 

1.19 

0.56 

0.00 

0.24 

0.98 

23166 

0.46 

45 

32 

0.38 

0.88 

-0.65 

0.84 

-0.36 

0.00 

0.54 

1.19 

23167 

-1.09 

44 

37 

0.45 

1.23 

0.94 

1.56 

0.94 

0.00 

0.20 

0.68 

23168 

-0.21 

46 

34 

0.39 

1.34 

1.55 

2.15 

2.25 

0.00 

0.24 

0.37 

23169 

-1.10 

44 

37 

0.48 

1.17 

0.67 

1.02 

0.27 

0.00 

0.38 

0.86 

23170 

0.72 

235 

148 

0.15 

1.04 

0.70 

1.20 

1.96 

0.00 

0.37 

0.85 

23171 

-2.78 

45 

44 

1.03 

0.97 

0.28 

0.36 

-0.14 

0.00 

0.20 

1.05 

23172 

-2.01 

46 

43 

0.66 

1.11 

0.37 

0.74 

0.04 

0.00 

0.33 

0.99 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23173 

-0.58 

45 

35 

0.41 

1.17 

0.80 

1.17 

0.49 

0.00 

0.35 

0.79 

23174 

-1.64 

45 

39 

0.50 

0.67 

-1.27 

0.30 

-0.70 

0.00 

0.56 

1.36 

23175 

1.49 

219 

109 

0.15 

1.11 

1.87 

1.08 

0.84 

0.00 

0.38 

0.72 

23176 

3.11 

45 

12 

0.41 

1.60 

2.46 

2.56 

2.43 

0.00 

0.20 

0.07 

23177 

-1.97 

45 

42 

0.66 

0.99 

0.14 

0.82 

0.18 

0.00 

0.32 

0.99 

23178 

-0.47 

46 

36 

0.40 

1.20 

0.99 

1.51 

1.11 

0.00 

0.24 

0.66 

23179 

-2.33 

45 

42 

0.64 

0.89 

-0.09 

0.46 

-0.27 

0.00 

0.39 

1.09 

23180 

-0.51 

46 

38 

0.44 

1.08 

0.38 

1.05 

0.27 

0.00 

0.38 

0.92 

23181 

-0.51 

43 

35 

0.44 

0.92 

-0.29 

0.60 

-0.57 

0.00 

0.47 

1.16 

23182 

-0.23 

45 

36 

0.43 

1.24 

1.06 

0.96 

0.09 

0.00 

0.35 

0.80 

23183 

-0.60 

44 

37 

0.44 

1.11 

0.50 

0.93 

0.03 

0.00 

0.24 

0.92 

23184 

-2.00 

46 

43 

0.63 

1.00 

0.16 

2.27 

1.24 

0.00 

0.17 

0.89 

23185 

0.39 

45 

30 

0.36 

1.57 

3.10 

1.59 

1.62 

0.00 

0.11 

-0.05 

23186 

-0.17 

47 

35 

0.37 

0.96 

-0.14 

1.24 

0.69 

0.00 

0.40 

0.98 

23187 

-0.29 

45 

36 

0.40 

1.17 

0.85 

2.93 

2.64 

0.00 

0.16 

0.57 

23188 

-0.27 

46 

36 

0.41 

0.98 

-0.01 

1.20 

0.54 

0.00 

0.45 

0.96 

23189 

0.08 

46 

33 

0.37 

0.96 

-0.17 

0.84 

-0.44 

0.00 

0.48 

1.10 

23190 

-0.90 

45 

38 

0.46 

1.04 

0.23 

1.46 

0.80 

0.00 

0.32 

0.87 

23191 

0.56 

45 

28 

0.37 

1.15 

0.94 

1.05 

0.28 

0.00 

0.46 

0.75 

23192 

-2.32 

45 

43 

0.76 

1.23 

0.56 

1.92 

1.01 

0.00 

0.03 

0.79 

23193 

0.85 

45 

25 

0.35 

1.36 

2.08 

1.47 

1.91 

0.00 

0.26 

0.27 

23194 

1.21 

52 

29 

0.33 

1.26 

1.59 

1.26 

1.02 

0.00 

0.40 

0.56 

23195 

1.69 

43 

20 

0.35 

1.15 

1.00 

1.07 

0.39 

0.00 

0.39 

0.72 

23196 

1.37 

46 

23 

0.35 

1.26 

1.66 

1.33 

1.40 

0.00 

0.36 

0.44 

23197 

-0.90 

45 

39 

0.50 

1.57 

1.60 

1.45 

0.85 

0.00 

0.13 

0.58 

23198 

1.33 

45 

22 

0.36 

1.21 

1.37 

1.58 

1.73 

0.00 

0.40 

0.47 

23199 

2.35 

45 

13 

0.38 

1.11 

0.65 

1.80 

2.00 

0.00 

0.34 

0.69 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23200 

0.85 

45 

27 

0.35 

1.15 

0.96 

1.51 

1.98 

0.00 

0.37 

0.56 

23201 

-0.24 

44 

33 

0.39 

0.87 

-0.71 

0.67 

-0.69 

0.00 

0.50 

1.28 

23202 

2.36 

45 

14 

0.37 

1.44 

2.38 

1.81 

1.93 

0.00 

0.13 

0.09 

23203 

1.10 

46 

29 

0.35 

0.97 

-0.14 

0.91 

-0.30 

0.00 

0.51 

1.08 

23204 

-0.62 

44 

35 

0.44 

1.13 

0.59 

1.00 

0.15 

0.00 

0.43 

0.88 

23205 

0.75 

45 

28 

0.35 

1.42 

2.72 

1.81 

3.06 

0.00 

0.15 

-0.16 

23206 

2.88 

45 

13 

0.39 

1.27 

1.39 

2.00 

2.26 

0.00 

0.28 

0.45 

23207 

-1.61 

45 

41 

0.55 

1.13 

0.46 

1.26 

0.57 

0.00 

0.16 

0.85 

23208 

0.03 

44 

33 

0.38 

0.97 

-0.09 

0.75 

-0.41 

0.00 

0.43 

1.10 

23209 

6.87 

46 

1 

1.06 

1.25 

0.56 

9.90 

7.30 

0.00 

-0.24 

0.27 

23210 

0.19 

45 

35 

0.41 

1.13 

0.69 

1.59 

1.26 

0.00 

0.34 

0.72 

23211 

0.71 

45 

29 

0.38 

1.32 

1.74 

1.30 

0.80 

0.00 

0.39 

0.43 

23212 

1.46 

45 

27 

0.36 

1.62 

3.56 

1.87 

2.76 

0.00 

0.18 

-0.42 

23213 

0.81 

45 

29 

0.36 

0.98 

-0.08 

0.85 

-0.46 

0.00 

0.51 

1.09 

23214 

0.73 

38 

23 

0.38 

1.21 

1.37 

1.20 

0.83 

0.00 

0.33 

0.51 

23215 

1.80 

45 

19 

0.35 

1.26 

1.71 

1.40 

1.58 

0.00 

0.31 

0.35 

23216 

1.28 

45 

22 

0.35 

1.21 

1.49 

1.41 

1.54 

0.00 

0.37 

0.46 

23217 

0.14 

44 

29 

0.37 

1.56 

2.78 

2.51 

3.92 

0.00 

0.11 

-0.22 

23218 

1.80 

43 

19 

0.37 

1.71 

3.56 

2.30 

2.98 

0.00 

0.19 

-0.39 

23219 

1.09 

46 

27 

0.35 

1.36 

2.23 

1.51 

2.08 

0.00 

0.27 

0.17 

23220 

1.54 

45 

22 

0.37 

1.50 

2.61 

1.58 

2.05 

0.00 

0.33 

0.07 

23221 

0.48 

45 

27 

0.36 

1.03 

0.23 

0.94 

-0.13 

0.00 

0.52 

0.99 

23222 

0.88 

42 

22 

0.35 

0.75 

-1.90 

0.65 

-1.68 

0.00 

0.65 

1.66 

23223 

0.73 

46 

28 

0.36 

1.14 

0.97 

1.31 

1.10 

0.00 

0.41 

0.62 

23224 

-0.56 

45 

37 

0.43 

1.05 

0.29 

0.80 

-0.26 

0.00 

0.41 

0.99 

23225 

0.60 

46 

29 

0.35 

1.15 

1.09 

1.18 

0.69 

0.00 

0.39 

0.64 

23226 

0.36 

43 

30 

0.39 

1.39 

1.90 

1.72 

1.74 

0.00 

0.26 

0.33 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23227 

1.88 

45 

17 

0.37 

1.60 

2.85 

1.68 

1.35 

0.00 

0.22 

0.05 

23228 

3.11 

46 

12 

0.40 

1.38 

1.65 

1.35 

0.81 

0.00 

0.34 

0.53 

23229 

0.68 

45 

31 

0.38 

0.74 

-1.45 

0.63 

-1.24 

0.00 

0.65 

1.42 

23230 

1.73 

45 

22 

0.35 

0.78 

-1.71 

0.65 

-1.57 

0.00 

0.66 

1.59 

23231 

-0.15 

44 

33 

0.39 

1.11 

0.65 

1.07 

0.31 

0.00 

0.33 

0.81 

23232 

0.18 

44 

32 

0.38 

0.96 

-0.17 

0.90 

-0.24 

0.00 

0.46 

1.07 

23233 

0.65 

45 

31 

0.37 

1.06 

0.41 

1.13 

0.50 

0.00 

0.44 

0.87 

23234 

1.45 

42 

19 

0.36 

1.07 

0.52 

1.21 

0.85 

0.00 

0.43 

0.77 

23235 

0.66 

44 

26 

0.37 

1.31 

1.79 

1.35 

1.01 

0.00 

0.38 

0.35 

23236 

-1.68 

45 

41 

0.58 

0.93 

-0.05 

0.86 

0.10 

0.00 

0.36 

1.02 

23237 

-0.77 

44 

38 

0.50 

1.10 

0.43 

1.45 

0.80 

0.00 

0.33 

0.84 

23238 

-0.70 

45 

38 

0.47 

0.94 

-0.11 

0.65 

-0.35 

0.00 

0.43 

1.11 

23239 

-1.39 

46 

40 

0.48 

0.96 

0.00 

0.60 

-0.52 

0.00 

0.45 

1.08 

23240 

0.14 

45 

32 

0.38 

0.85 

-0.85 

0.71 

-0.91 

0.00 

0.56 

1.30 

23241 

-0.83 

44 

33 

0.40 

1.18 

0.99 

1.20 

0.53 

0.00 

0.35 

0.69 

23242 

-0.07 

45 

36 

0.42 

0.91 

-0.30 

0.84 

-0.23 

0.00 

0.47 

1.09 

23243 

3.49 

45 

9 

0.44 

1.13 

0.59 

1.03 

0.27 

0.00 

0.42 

0.86 

23244 

-0.39 

45 

35 

0.39 

1.07 

0.42 

0.78 

-0.45 

0.00 

0.37 

1.00 

23245 

-0.84 

45 

36 

0.43 

1.16 

0.71 

1.18 

0.48 

0.00 

0.37 

0.81 

23246 

-0.72 

44 

37 

0.48 

1.52 

1.65 

5.52 

3.45 

0.00 

0.09 

0.28 

23247 

0.86 

45 

26 

0.34 

0.82 

-1.51 

0.75 

-1.28 

0.00 

0.58 

1.53 

23248 

-1.43 

44 

40 

0.58 

1.04 

0.23 

1.05 

0.33 

0.00 

0.30 

0.95 

23249 

0.04 

45 

32 

0.38 

0.92 

-0.35 

0.96 

0.00 

0.00 

0.51 

1.08 

23250 

-1.46 

46 

40 

0.50 

0.75 

-0.84 

1.63 

0.99 

0.00 

0.51 

1.12 

23251 

0.56 

45 

32 

0.38 

1.16 

0.90 

1.19 

0.78 

0.00 

0.38 

0.71 

23252 

2.32 

45 

16 

0.39 

1.06 

0.34 

1.03 

0.20 

0.00 

0.57 

0.92 

23253 

-1.13 

45 

39 

0.48 

1.04 

0.23 

0.94 

0.15 

0.00 

0.31 

0.96 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23254 

0.15 

50 

34 

0.37 

1.21 

1.21 

1.52 

1.06 

0.00 

0.41 

0.56 

23255 

-1.03 

44 

37 

0.45 

0.80 

-0.74 

0.58 

-0.56 

0.00 

0.50 

1.22 

23256 

1.18 

45 

24 

0.36 

1.00 

0.05 

0.84 

-0.44 

0.00 

0.55 

1.07 

23257 

1.15 

45 

23 

0.34 

1.23 

1.53 

1.44 

1.85 

0.00 

0.31 

0.41 

23258 

-0.44 

46 

38 

0.43 

1.00 

0.07 

0.96 

0.10 

0.00 

0.38 

1.01 

23259 

-0.30 

45 

34 

0.39 

1.16 

0.88 

0.99 

0.12 

0.00 

0.35 

0.80 

23260 

0.74 

44 

25 

0.36 

1.29 

1.71 

2.07 

2.89 

0.00 

0.34 

0.27 

23261 

0.00 

44 

32 

0.38 

1.07 

0.44 

0.89 

-0.20 

0.00 

0.42 

0.95 

23262 

0.48 

45 

32 

0.37 

0.98 

-0.04 

0.83 

-0.47 

0.00 

0.48 

1.08 

23263 

1.29 

46 

25 

0.35 

1.20 

1.36 

1.22 

0.84 

0.00 

0.42 

0.56 

23264 

1.77 

45 

19 

0.35 

1.08 

0.54 

1.37 

1.22 

0.00 

0.43 

0.72 

23265 

1.18 

45 

25 

0.37 

0.90 

-0.51 

1.12 

0.54 

0.00 

0.62 

1.10 

23266 

0.07 

44 

34 

0.40 

1.15 

0.77 

1.81 

1.78 

0.00 

0.27 

0.73 

23267 

1.95 

45 

20 

0.35 

1.08 

0.55 

1.21 

0.85 

0.00 

0.44 

0.79 

23268 

2.21 

44 

19 

0.37 

1.35 

1.89 

1.73 

2.20 

0.00 

0.38 

0.32 

23269 

0.72 

46 

28 

0.34 

1.00 

0.05 

1.27 

1.16 

0.00 

0.42 

0.87 

23270 

2.94 

46 

11 

0.39 

1.17 

0.84 

1.31 

0.77 

0.00 

0.33 

0.74 

23271 

3.62 

45 

9 

0.45 

1.05 

0.28 

1.26 

0.59 

0.00 

0.48 

0.90 

23272 

2.65 

45 

14 

0.38 

1.59 

2.82 

3.66 

3.84 

0.00 

0.11 

-0.21 

23273 

5.24 

45 

2 

0.76 

1.26 

0.60 

5.44 

2.27 

0.00 

-0.12 

0.64 

23274 

1.81 

46 

21 

0.37 

1.05 

0.34 

1.05 

0.27 

0.00 

0.58 

0.92 

23275 

-0.95 

46 

39 

0.45 

0.74 

-0.95 

0.72 

-0.31 

0.00 

0.50 

1.23 

23276 

1.32 

43 

25 

0.35 

0.97 

-0.15 

0.87 

-0.46 

0.00 

0.50 

1.12 

23277 

0.82 

45 

28 

0.36 

1.44 

2.61 

4.37 

4.57 

0.00 

0.21 

-0.25 

23278 

0.77 

45 

26 

0.36 

0.83 

-1.14 

0.68 

-1.15 

0.00 

0.64 

1.37 

23279 

0.66 

46 

26 

0.34 

1.05 

0.40 

1.10 

0.59 

0.00 

0.43 

0.85 

23280 

1.40 

45 

19 

0.36 

0.72 

-1.94 

0.62 

-1.62 

0.00 

0.69 

1.59 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23281 

-1.25 

45 

40 

0.53 

0.94 

-0.05 

1.13 

0.42 

0.00 

0.36 

1.02 

23282 

-0.44 

44 

34 

0.42 

0.75 

-1.08 

0.59 

-0.92 

0.00 

0.61 

1.30 

23283 

-0.47 

44 

36 

0.45 

0.85 

-0.56 

0.56 

-0.69 

0.00 

0.54 

1.21 

23284 

-0.01 

44 

34 

0.42 

0.89 

-0.42 

1.05 

0.28 

0.00 

0.50 

1.06 

23285 

2.29 

45 

14 

0.38 

1.18 

0.92 

1.61 

1.76 

0.00 

0.39 

0.64 

23286 

2.68 

45 

15 

0.37 

1.34 

1.80 

2.18 

2.94 

0.00 

0.21 

0.23 

23287 

0.35 

45 

31 

0.38 

1.28 

1.64 

1.80 

1.99 

0.00 

0.32 

0.36 

23288 

0.36 

44 

27 

0.35 

0.86 

-0.89 

0.77 

-1.00 

0.00 

0.58 

1.32 

23289 

-0.35 

46 

35 

0.40 

1.05 

0.31 

1.76 

1.56 

0.00 

0.40 

0.80 

23290 

-0.57 

45 

36 

0.45 

0.90 

-0.29 

0.70 

-0.44 

0.00 

0.56 

1.13 

23291 

1.71 

45 

20 

0.37 

1.40 

2.19 

1.86 

2.45 

0.00 

0.36 

0.18 

23292 

1.05 

52 

30 

0.33 

1.16 

1.05 

1.24 

1.01 

0.00 

0.44 

0.69 

23293 

0.39 

44 

31 

0.37 

1.23 

1.25 

1.19 

0.76 

0.00 

0.27 

0.65 

23294 

1.46 

45 

24 

0.36 

0.69 

-2.11 

0.57 

-1.71 

0.00 

0.71 

1.63 

23295 

2.04 

44 

16 

0.35 

1.43 

2.68 

3.11 

4.28 

0.00 

0.06 

-0.29 

23296 

0.85 

45 

27 

0.35 

1.02 

0.17 

0.93 

-0.14 

0.00 

0.49 

1.00 

23297 

0.87 

46 

29 

0.37 

1.33 

1.79 

1.42 

1.32 

0.00 

0.39 

0.41 

23298 

1.82 

46 

21 

0.37 

1.07 

0.48 

1.00 

0.09 

0.00 

0.55 

0.89 

23299 

1.17 

45 

21 

0.34 

1.12 

0.81 

1.07 

0.42 

0.00 

0.40 

0.77 

23300 

1.32 

45 

23 

0.35 

1.14 

0.98 

1.16 

0.73 

0.00 

0.42 

0.69 

23301 

1.47 

45 

29 

0.36 

1.10 

0.68 

1.30 

1.07 

0.00 

0.41 

0.71 

23302 

2.04 

45 

19 

0.36 

1.22 

1.40 

1.42 

1.63 

0.00 

0.41 

0.44 

23303 

1.33 

46 

23 

0.33 

1.14 

1.17 

1.37 

1.67 

0.00 

0.33 

0.46 

23304 

0.99 

44 

26 

0.38 

0.80 

-1.07 

0.87 

-0.40 

0.00 

0.66 

1.29 

23305 

1.52 

44 

21 

0.39 

1.02 

0.14 

0.87 

-0.09 

0.00 

0.62 

1.01 

23306 

0.61 

45 

29 

0.38 

1.59 

2.86 

1.73 

1.98 

0.00 

0.25 

-0.04 

23307 

3.44 

45 

11 

0.42 

1.40 

1.68 

2.67 

2.38 

0.00 

0.24 

0.33 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23308 

1.45 

44 

22 

0.35 

1.06 

0.52 

1.41 

1.69 

0.00 

0.41 

0.65 

23309 

2.84 

43 

9 

0.43 

1.90 

3.12 

5.62 

4.56 

0.00 

-0.29 

-0.45 

23310 

2.39 

45 

16 

0.37 

1.17 

1.06 

1.62 

1.84 

0.00 

0.37 

0.52 

23311 

3.11 

45 

11 

0.42 

1.52 

2.10 

3.23 

2.60 

0.00 

0.17 

0.05 

23312 

1.71 

44 

17 

0.38 

1.01 

0.12 

0.92 

-0.06 

0.00 

0.55 

1.00 

23313 

2.51 

45 

14 

0.39 

1.45 

2.18 

2.10 

2.46 

0.00 

0.25 

0.16 

23314 

1.80 

46 

21 

0.34 

1.45 

2.83 

1.53 

2.26 

0.00 

0.21 

-0.08 

23315 

1.67 

43 

21 

0.38 

1.10 

0.62 

1.23 

0.87 

0.00 

0.53 

0.77 

23316 

1.74 

44 

19 

0.36 

0.85 

-1.02 

0.87 

-0.46 

0.00 

0.60 

1.31 

23317 

1.05 

45 

25 

0.35 

1.13 

0.95 

1.09 

0.45 

0.00 

0.42 

0.72 

23318 

0.63 

43 

29 

0.40 

0.95 

-0.18 

0.85 

-0.21 

0.00 

0.59 

1.08 

23319 

1.68 

45 

19 

0.35 

0.96 

-0.20 

0.93 

-0.15 

0.00 

0.53 

1.07 

23320 

1.32 

45 

26 

0.37 

0.90 

-0.50 

0.95 

-0.08 

0.00 

0.61 

1.14 

23321 

1.56 

45 

22 

0.36 

0.90 

-0.62 

0.86 

-0.53 

0.00 

0.59 

1.20 

23322 

1.66 

42 

21 

0.38 

0.96 

-0.25 

0.98 

-0.01 

0.00 

0.56 

1.09 

23323 

1.20 

45 

26 

0.35 

1.14 

0.94 

1.16 

0.76 

0.00 

0.39 

0.69 

23324 

0.65 

45 

28 

0.36 

1.11 

0.70 

1.06 

0.30 

0.00 

0.46 

0.81 

23325 

0.81 

45 

27 

0.36 

1.14 

0.90 

1.37 

1.29 

0.00 

0.42 

0.67 

23326 

1.21 

44 

25 

0.37 

1.39 

2.27 

1.69 

2.38 

0.00 

0.32 

0.10 

23327 

0.66 

45 

26 

0.35 

1.01 

0.15 

0.93 

-0.19 

0.00 

0.50 

1.00 

23328 

1.45 

46 

24 

0.35 

1.22 

1.27 

1.48 

1.83 

0.00 

0.39 

0.54 

23329 

0.97 

45 

26 

0.34 

1.08 

0.67 

1.09 

0.45 

0.00 

0.41 

0.76 

23330 

1.11 

45 

25 

0.36 

0.96 

-0.20 

1.12 

0.53 

0.00 

0.54 

1.01 

23331 

-0.96 

45 

38 

0.45 

0.97 

-0.01 

0.84 

-0.07 

0.00 

0.38 

1.04 

23332 

0.90 

45 

28 

0.34 

1.03 

0.27 

1.12 

0.61 

0.00 

0.38 

0.88 

23333 

-0.53 

45 

35 

0.41 

0.86 

-0.63 

0.70 

-0.55 

0.00 

0.51 

1.20 

23334 

-0.68 

45 

37 

0.44 

1.04 

0.25 

1.31 

0.67 

0.00 

0.34 

0.89 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23335 

-0.46 

45 

37 

0.45 

0.78 

-0.84 

0.48 

-0.87 

0.00 

0.58 

1.28 

23336 

-1.26 

43 

38 

0.53 

0.82 

-0.47 

0.48 

-0.49 

0.00 

0.48 

1.18 

23337 

-1.91 

45 

42 

0.63 

0.99 

0.13 

1.01 

0.33 

0.00 

0.23 

0.97 

23338 

0.15 

45 

30 

0.37 

1.11 

0.64 

1.06 

0.29 

0.00 

0.46 

0.83 

23339 

0.15 

45 

31 

0.37 

0.86 

-0.84 

0.68 

-0.92 

0.00 

0.54 

1.32 

23340 

-0.95 

45 

38 

0.46 

0.94 

-0.13 

1.15 

0.44 

0.00 

0.38 

0.99 

23341 

-0.74 

45 

36 

0.43 

0.80 

-0.78 

0.63 

-0.54 

0.00 

0.55 

1.22 

23342 

-0.27 

45 

35 

0.42 

1.30 

1.36 

2.53 

2.53 

0.00 

0.27 

0.35 

23343 

-2.27 

46 

44 

0.75 

1.07 

0.32 

0.52 

-0.04 

0.00 

0.23 

1.01 

23344 

-0.78 

46 

38 

0.47 

1.15 

0.60 

1.01 

0.23 

0.00 

0.47 

0.89 

23345 

0.23 

44 

31 

0.39 

1.03 

0.20 

0.90 

-0.17 

0.00 

0.50 

1.00 

23346 

-0.89 

45 

39 

0.48 

0.81 

-0.62 

0.42 

-0.76 

0.00 

0.51 

1.23 

23347 

-0.47 

45 

38 

0.45 

1.17 

0.67 

1.06 

0.28 

0.00 

0.26 

0.87 

23348 

-0.45 

45 

36 

0.43 

0.93 

-0.25 

0.60 

-0.55 

0.00 

0.52 

1.15 

23349 

-1.53 

45 

40 

0.52 

0.88 

-0.26 

0.57 

-0.31 

0.00 

0.44 

1.12 

23350 

0.46 
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142 

0.18 

1.01 

0.13 

0.86 

-0.83 

0.00 

0.46 

1.03 

23351 

-1.22 

45 

40 

0.53 

1.07 

0.32 

1.59 

0.85 

0.00 

0.27 

0.83 

23352 

0.15 

45 

30 

0.35 

0.98 

-0.08 

0.83 

-0.50 

0.00 

0.47 

1.10 

23353 

-0.18 

46 

34 

0.40 

0.86 

-0.65 

1.03 

0.24 

0.00 

0.52 

1.13 

23354 

0.03 

45 

33 

0.39 

1.11 

0.63 

1.08 

0.32 

0.00 

0.41 

0.84 

23355 

-2.20 

45 

43 

0.75 

1.20 

0.52 

2.34 

1.20 

0.00 

-0.01 

0.78 

23356 

-0.52 

187 

158 

0.22 

0.82 

-1.40 

0.81 

-0.61 

0.00 

0.47 

1.17 

23357 

-0.21 

46 

33 

0.41 

0.95 

-0.17 

0.81 

-0.30 

0.00 

0.58 

1.09 

23358 

-0.28 

45 

35 

0.40 

0.96 

-0.13 

0.84 

-0.21 

0.00 

0.43 

1.07 

23359 

0.20 

45 

32 

0.37 

0.86 

-0.86 

0.74 

-0.62 

0.00 

0.50 

1.29 

23360 

-0.56 

44 

35 

0.42 

1.09 

0.49 

1.66 

1.25 

0.00 

0.31 

0.78 

23361 

-0.91 

44 

38 

0.48 

0.83 

-0.54 

0.58 

-0.47 

0.00 

0.43 

1.19 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23362 

-0.97 

45 

38 

0.47 

1.01 

0.13 

0.61 

-0.34 

0.00 

0.46 

1.06 

23363 

-0.31 

45 

37 

0.44 

0.79 

-0.86 

0.63 

-0.78 

0.00 

0.51 

1.26 

23364 

0.50 

43 

28 

0.38 

1.00 

0.06 

0.81 

-0.54 

0.00 

0.52 

1.08 

23365 

-0.19 

44 

31 

0.38 

1.18 

0.94 

1.56 

1.62 

0.00 

0.35 

0.68 

23366 

-2.46 

45 

42 

0.64 

0.83 

-0.22 

0.86 

0.25 

0.00 

0.35 

1.07 

23367 

0.40 

46 

30 

0.36 

1.08 

0.54 

1.26 

0.90 

0.00 

0.42 

0.79 

23368 

-0.07 

45 

35 

0.41 

1.06 

0.34 

1.03 

0.24 

0.00 

0.41 

0.91 

23369 

-0.22 

45 

36 

0.43 

1.02 

0.18 

1.69 

1.19 

0.00 

0.40 

0.87 

23370 

-0.20 

44 

31 

0.39 

1.01 

0.10 

0.82 

-0.30 

0.00 

0.51 

1.03 

23371 

-0.80 

44 

35 

0.46 

0.97 

-0.01 

0.82 

-0.13 

0.00 

0.53 

1.03 

23372 

-1.99 

44 

40 

0.63 

0.82 

-0.24 

0.51 

-0.24 

0.00 

0.53 

1.11 

23373 

-0.17 

2501 

1902 

0.05 

0.96 

-1.31 

0.97 

-0.53 

0.00 

0.47 

1.05 

23374 

-0.54 

44 

34 

0.43 

0.97 

-0.07 

0.78 

-0.35 

0.00 

0.51 

1.08 

23375 

0.32 

44 

31 

0.39 

0.94 

-0.26 

0.85 

-0.27 

0.00 

0.54 

1.10 

23376 

0.66 

45 

31 

0.37 

0.99 

0.02 

0.88 

-0.27 

0.00 

0.49 

1.04 

23377 

-0.42 

43 

35 

0.44 

0.77 

-0.91 

0.50 

-1.10 

0.00 

0.54 

1.30 

23378 

-1.76 

46 

42 

0.56 

0.70 

-0.70 

0.35 

-0.78 

0.00 

0.50 

1.22 

23379 

-0.75 

44 

36 

0.44 

1.22 

0.89 

1.12 

0.39 

0.00 

0.28 

0.79 

23380 

-0.52 

45 

36 

0.42 

0.95 

-0.13 

0.68 

-0.59 

0.00 

0.48 

1.12 

23381 

-0.09 

45 

33 

0.40 

0.81 

-0.89 

0.63 

-0.76 

0.00 

0.58 

1.29 

23382 

-0.30 

45 

36 

0.42 

1.08 

0.42 

1.55 

1.18 

0.00 

0.32 

0.83 

23383 

-0.19 

45 

35 

0.41 

0.74 

-1.30 

0.53 

-0.88 

0.00 

0.57 

1.40 

23384 

-1.95 

42 

38 

0.64 

0.92 

-0.03 

2.48 

1.43 

0.00 

0.48 

0.96 

23385 

-0.52 

44 

35 

0.43 

1.04 

0.27 

3.03 

2.23 

0.00 

0.33 

0.71 

23386 

0.45 

202 

137 

0.17 

1.10 

1.36 

1.08 

0.58 

0.00 

0.37 

0.81 

23387 

0.12 

45 

32 

0.39 

1.11 

0.57 

1.19 

0.64 

0.00 

0.45 

0.84 

23388 

-0.22 

44 

32 

0.41 

1.01 

0.09 

0.97 

0.10 

0.00 

0.52 

0.98 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

23389 

0.27 

210 

152 

0.17 

0.87 

-1.53 

0.78 

-1.44 

0.00 

0.53 

1.21 

23390 

-1.55 

45 

41 

0.56 

0.95 

-0.01 

0.52 

-0.27 

0.00 

0.35 

1.08 

23391 

-0.06 

45 

32 

0.40 

1.12 

0.60 

1.14 

0.49 

0.00 

0.49 

0.84 

23392 

0.52 

46 

28 

0.35 

0.84 

-1.19 

1.00 

0.09 

0.00 

0.55 

1.32 

23393 

-1.19 

44 

36 

0.46 

1.28 

1.03 

2.55 

1.97 

0.00 

0.25 

0.59 

23394 

0.14 

45 

32 

0.37 

0.84 

-1.05 

0.81 

-0.60 

0.00 

0.49 

1.32 

23395 

-0.33 

45 

36 

0.42 

0.86 

-0.57 

0.95 

0.05 

0.00 

0.46 

1.12 

23396 

-0.75 

43 

35 

0.46 

0.73 

-1.07 

0.50 

-0.63 

0.00 

0.59 

1.30 

23397 

-0.50 

206 

168 

0.20 

1.02 

0.22 

1.03 

0.21 

0.00 

0.34 

0.98 

23398 

0.24 

45 

31 

0.37 

1.07 

0.46 

1.13 

0.49 

0.00 

0.42 

0.86 

23399 

-0.05 

46 

35 

0.39 

1.00 

0.04 

0.95 

0.01 

0.00 

0.44 

1.01 

23400 

0.65 

46 

30 

0.37 

1.43 

2.24 

1.89 

2.24 

0.00 

0.29 

0.19 

2G11 

-0.41 

101 

88 

0.32 

1.34 

1.57 

2.83 

3.22 

0.00 

0.01 

0.61 

2G110 

-0.76 

112 

94 

0.28 

0.98 

-0.06 

0.99 

0.05 

0.00 

0.34 

1.01 

2G111 

-3.39 

89 

88 

1.01 

0.97 

0.29 

0.31 

-0.38 

0.00 

0.15 

1.05 

2G112 

2.52 

72 

30 

0.27 

1.19 

1.58 

1.22 

1.22 

0.01 

0.35 

0.57 

2G113 

1.18 

68 

44 

0.30 

1.33 

2.17 

2.03 

3.00 

0.01 

0.28 

0.34 

2G114 

-0.63 

70 

61 

0.39 

1.21 

0.92 

1.75 

1.26 

0.00 

0.19 

0.75 

2G115 

0.54 

68 

53 

0.33 

1.02 

0.18 

0.88 

-0.29 

0.00 

0.43 

1.01 

2G116 

0.83 

74 

45 

0.27 

1.01 

0.15 

1.22 

1.21 

0.00 

0.41 

0.89 

2G117 

1.68 

92 

48 

0.24 

1.30 

3.03 

1.44 

2.81 

0.00 

0.23 

0.12 

2G118 

3.20 

83 

16 

0.30 

1.14 

0.78 

1.21 

0.77 

0.00 

0.26 

0.84 

2G119 

-1.77 

78 

73 

0.48 

1.09 

0.35 

0.78 

-0.09 

0.00 

0.19 

0.97 

2G12 

1.01 

80 

58 

0.28 

1.00 

0.08 

1.18 

0.76 

0.00 

0.43 

0.96 

2G120 

-1.47 

167 

157 

0.34 

1.04 

0.24 

1.20 

0.54 

0.00 

0.18 

0.96 

2G121 

0.74 

74 

44 

0.28 

1.04 

0.42 

0.98 

-0.07 

0.00 

0.47 

0.93 

2G122 

-1.93 

84 

80 

0.53 

1.16 

0.49 

2.55 

1.65 

0.00 

-0.04 

0.82 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2G123 

0.45 

70 

50 

0.29 

1.16 

1.27 

1.43 

1.69 

0.00 

0.20 

0.60 

2G124 

-1.36 

101 

95 

0.44 

1.07 

0.31 

2.00 

1.38 

0.00 

0.15 

0.92 

2G125 

0.01 

135 

109 

0.25 

0.96 

-0.22 

1.03 

0.20 

0.01 

0.42 

0.99 

2G126 

-1.84 

111 

104 

0.40 

0.88 

-0.27 

0.57 

-0.84 

0.00 

0.36 

1.10 

2G127 

-2.24 

88 

85 

0.60 

1.01 

0.20 

0.97 

0.27 

0.00 

0.15 

0.99 

2G128 

-1.31 

72 

68 

0.53 

1.08 

0.32 

1.03 

0.32 

0.01 

0.17 

0.95 

2G129 

-3.05 

68 

67 

1.03 

1.01 

0.32 

0.31 

-0.27 

0.01 

0.18 

1.03 

2G13 

-1.65 

69 

65 

0.54 

1.03 

0.20 

0.80 

0.06 

0.00 

0.23 

0.99 

2G130 

-0.56 

68 

61 

0.43 

1.00 

0.09 

0.63 

-0.53 

0.00 

0.36 

1.05 

2G131 

-1.63 

174 

164 

0.34 

1.10 

0.46 

1.29 

0.70 

0.00 

0.10 

0.92 

2G132 

-1.16 

74 

66 

0.39 

1.04 

0.23 

0.87 

-0.07 

0.00 

0.27 

0.98 

2G133 

0.62 

92 

66 

0.26 

1.08 

0.70 

1.00 

0.05 

0.00 

0.36 

0.89 

2G134 

-0.73 

83 

72 

0.34 

1.19 

0.86 

1.46 

1.07 

0.00 

0.09 

0.81 

2G135 

1.11 

78 

43 

0.26 

1.08 

0.86 

1.10 

0.72 

0.00 

0.38 

0.76 

2G136 

1.47 

80 

52 

0.27 

1.11 

0.93 

1.05 

0.30 

0.00 

0.41 

0.82 

2G137 

0.58 

74 

46 

0.28 

1.17 

1.39 

1.31 

1.47 

0.00 

0.38 

0.60 

2G138 

-0.51 

84 

71 

0.32 

1.13 

0.69 

1.77 

1.61 

0.00 

0.18 

0.81 

2G139 

2.25 

69 

25 

0.28 

1.31 

2.27 

1.46 

2.42 

0.00 

0.16 

0.33 

2G14 

-1.36 

100 

94 

0.44 

0.95 

-0.05 

0.48 

-0.73 

0.00 

0.34 

1.07 

2G140 

1.76 

109 

42 

0.22 

1.01 

0.13 

1.04 

0.34 

0.00 

0.39 

0.96 

2G141 

2.37 

88 

31 

0.25 

1.08 

0.76 

1.12 

0.76 

0.00 

0.39 

0.81 

2G142 

-1.63 

72 

69 

0.61 

0.99 

0.16 

0.46 

-0.44 

0.01 

0.26 

1.05 

2G15 

2.21 

68 

32 

0.29 

1.02 

0.20 

1.07 

0.38 

0.01 

0.51 

0.93 

2G16 

2.54 

69 

26 

0.29 

1.44 

3.15 

1.99 

3.40 

0.00 

0.21 

-0.06 

2G17 

1.13 

68 

47 

0.30 

1.22 

1.48 

1.21 

0.94 

0.00 

0.33 

0.64 

2G18 

-1.01 

74 

65 

0.38 

1.22 

0.92 

1.25 

0.62 

0.00 

0.13 

0.81 

2G19 

1.40 

92 

53 

0.24 

1.15 

1.61 

1.14 

0.93 

0.00 

0.34 

0.61 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2G21 

-1.92 

83 

79 

0.53 

0.97 

0.07 

1.12 

0.40 

0.00 

0.19 

1.00 

2G210 

0.44 

78 

53 

0.27 

1.25 

2.05 

1.61 

2.52 

0.00 

0.18 

0.37 

2G211 

-2.86 

80 

79 

1.02 

1.04 

0.35 

0.48 

-0.07 

0.00 

0.14 

1.00 

2G212 

-2.45 

74 

70 

0.60 

0.99 

0.14 

0.60 

-0.18 

0.00 

0.34 

1.03 

2G213 

-1.68 

84 

79 

0.48 

1.00 

0.13 

0.63 

-0.35 

0.00 

0.25 

1.03 

2G214 

0.28 

69 

51 

0.30 

1.11 

0.83 

1.24 

0.94 

0.00 

0.26 

0.78 

2G215 

-0.48 

187 

159 

0.22 

0.95 

-0.31 

0.78 

-0.83 

0.00 

0.38 

1.06 

2G216 

-1.82 

100 

96 

0.53 

0.89 

-0.12 

0.42 

-0.67 

0.00 

0.33 

1.09 

2G217 

-1.42 

109 

99 

0.34 

1.03 

0.19 

1.09 

0.35 

0.00 

0.21 

0.98 

2G218 

-0.25 

158 

132 

0.24 

1.09 

0.70 

1.28 

0.96 

0.00 

0.29 

0.87 

2G219 

-1.00 

88 

79 

0.37 

1.06 

0.31 

1.85 

1.57 

0.00 

0.16 

0.89 

2G22 

-2.80 

72 

71 

1.02 

0.91 

0.23 

0.18 

-0.53 

0.01 

0.24 

1.08 

2G220 

-1.51 

68 

64 

0.55 

0.76 

-0.49 

0.30 

-0.72 

0.01 

0.42 

1.17 

2G221 

-1.65 

69 

65 

0.54 

1.09 

0.34 

2.74 

1.65 

0.00 

0.12 

0.86 

2G222 

-1.57 

68 

65 

0.61 

0.99 

0.14 

1.71 

0.92 

0.00 

0.19 

0.97 

2G223 

-3.45 

74 

73 

1.01 

1.03 

0.35 

0.90 

0.35 

0.00 

0.07 

0.97 

2G224 

-0.89 

92 

83 

0.37 

0.95 

-0.10 

0.74 

-0.37 

0.00 

0.32 

1.04 

2G225 

0.25 

83 

61 

0.27 

1.32 

2.33 

1.54 

1.97 

0.00 

0.05 

0.39 

2G226 

-0.29 

78 

62 

0.30 

0.91 

-0.54 

0.98 

0.06 

0.00 

0.41 

1.11 

2G227 

-1.08 

80 

75 

0.49 

1.03 

0.21 

2.01 

1.25 

0.00 

0.15 

0.88 

2G228 

-2.45 

73 

70 

0.60 

0.96 

0.09 

0.60 

-0.19 

0.00 

0.22 

1.04 

2G229 

-3.39 

84 

83 

1.01 

1.04 

0.37 

1.91 

1.00 

0.00 

-0.01 

0.93 

2G23 

-1.95 

69 

66 

0.60 

1.00 

0.17 

0.85 

0.12 

0.00 

0.16 

1.00 

2G230 

0.45 

98 

75 

0.27 

1.11 

0.83 

0.98 

0.00 

0.00 

0.36 

0.89 

2G231 

-1.22 

83 

75 

0.39 

1.10 

0.42 

1.32 

0.80 

0.00 

0.13 

0.93 

2G232 

-1.89 

86 

82 

0.52 

0.93 

-0.01 

0.66 

-0.23 

0.00 

0.25 

1.05 

2G233 

-2.80 

69 

68 

1.02 

1.03 

0.35 

0.62 

0.11 

0.01 

0.11 

1.00 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2G234 

-0.82 

68 

61 

0.43 

1.08 

0.35 

2.29 

1.51 

0.01 

0.20 

0.80 

2G235 

3.84 

67 

13 

0.36 

1.24 

1.14 

2.19 

2.01 

0.00 

0.28 

0.59 

2G236 

-1.54 

67 

64 

0.61 

1.02 

0.20 

0.99 

0.33 

0.00 

0.20 

0.97 

2G237 

0.00 

73 

73 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

2G238 

-1.84 

91 

87 

0.53 

0.85 

-0.21 

0.40 

-0.75 

0.00 

0.33 

1.11 

2G239 

-1.18 

135 

125 

0.35 

0.85 

-0.55 

0.39 

-1.26 

0.00 

0.40 

1.14 

2G24 

-2.23 

83 

80 

0.60 

0.96 

0.10 

1.21 

0.51 

0.00 

0.18 

1.01 

2G240 

-1.22 

78 

70 

0.39 

1.09 

0.41 

1.41 

0.85 

0.00 

0.16 

0.88 

2G241 

-0.20 

80 

70 

0.37 

0.89 

-0.41 

0.78 

-0.31 

0.00 

0.43 

1.10 

2G25 

-2.45 

72 

69 

0.60 

1.00 

0.18 

0.74 

0.00 

0.00 

0.18 

1.01 

2G26 

-1.68 

84 

79 

0.48 

1.02 

0.17 

1.11 

0.38 

0.00 

0.17 

0.96 

2G27 

-2.38 

69 

67 

0.73 

0.99 

0.21 

0.63 

-0.05 

0.00 

0.16 

1.02 

2G28 

2.52 

98 

38 

0.23 

0.90 

-1.13 

0.87 

-0.80 

0.00 

0.51 

1.25 

2G29 

-2.74 

82 

80 

0.73 

0.95 

0.14 

0.43 

-0.42 

0.00 

0.26 

1.06 

2G31 

-1.26 

86 

79 

0.41 

1.01 

0.14 

0.71 

-0.40 

0.00 

0.26 

1.02 

2G310 

0.00 

69 

69 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

2G311 

1.38 

156 

90 

0.18 

1.28 

3.52 

1.41 

3.30 

0.00 

0.22 

0.25 

2G312 

-1.51 

68 

64 

0.55 

0.72 

-0.61 

0.26 

-0.82 

0.01 

0.44 

1.19 

2G313 

-1.13 

67 

61 

0.46 

0.98 

0.03 

0.64 

-0.30 

0.00 

0.34 

1.05 

2G314 

0.90 

67 

49 

0.31 

1.21 

1.28 

1.41 

1.46 

0.00 

0.32 

0.68 

2G315 

-2.27 

73 

70 

0.60 

1.00 

0.18 

0.61 

-0.15 

0.00 

0.21 

1.02 

2G316 

2.31 

91 

36 

0.24 

1.28 

2.57 

1.44 

2.51 

0.00 

0.24 

0.31 

2G317 

2.04 

156 

60 

0.19 

1.27 

3.00 

1.58 

3.85 

0.00 

0.28 

0.36 

2G318 

-1.46 

83 

77 

0.44 

0.89 

-0.22 

0.56 

-0.64 

0.00 

0.34 

1.09 

2G319 

0.58 

78 

51 

0.26 

1.00 

0.02 

0.93 

-0.33 

0.00 

0.43 

1.03 

2G32 

-1.35 

80 

76 

0.54 

0.76 

-0.47 

0.26 

-0.87 

0.00 

0.42 

1.16 

2G320 

0.43 

72 

47 

0.28 

1.27 

2.10 

1.25 

1.16 

0.00 

0.29 

0.45 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2G321 

1.73 

84 

39 

0.25 

1.24 

2.37 

1.27 

1.72 

0.00 

0.27 

0.36 

2G322 

2.93 

69 

17 

0.31 

0.95 

-0.30 

1.16 

0.68 

0.00 

0.42 

1.02 

2G323 

-1.16 

98 

91 

0.41 

1.03 

0.20 

1.17 

0.47 

0.00 

0.25 

0.98 

2G324 

1.03 

81 

45 

0.24 

1.08 

1.04 

1.10 

0.94 

0.00 

0.27 

0.68 

2G325 

-1.44 

86 

80 

0.44 

1.02 

0.18 

1.01 

0.23 

0.00 

0.20 

0.98 

2G326 

0.78 

69 

50 

0.30 

1.07 

0.54 

1.03 

0.19 

0.01 

0.36 

0.90 

2G327 

-1.02 

68 

62 

0.46 

0.86 

-0.34 

1.22 

0.53 

0.01 

0.34 

1.03 

2G328 

-2.39 

67 

65 

0.74 

1.06 

0.31 

1.05 

0.45 

0.00 

0.13 

0.95 

2G329 

0.70 

67 

51 

0.33 

1.34 

1.83 

1.62 

1.84 

0.00 

0.20 

0.49 

2G33 

2.31 

72 

24 

0.28 

1.14 

1.08 

1.31 

1.42 

0.00 

0.32 

0.69 

2G330 

-0.32 

91 

77 

0.31 

0.93 

-0.33 

0.67 

-0.82 

0.00 

0.41 

1.11 

2G331 

-1.12 

83 

75 

0.39 

1.02 

0.17 

0.89 

-0.03 

0.00 

0.24 

0.99 

2G332 

-0.81 

78 

67 

0.35 

0.83 

-0.76 

0.77 

-0.43 

0.00 

0.42 

1.15 

2G333 

0.67 

80 

62 

0.30 

1.15 

0.96 

1.19 

0.67 

0.00 

0.33 

0.80 

2G334 

-0.89 

72 

61 

0.35 

0.96 

-0.11 

1.01 

0.17 

0.00 

0.32 

1.01 

2G335 

-0.98 

84 

75 

0.37 

0.87 

-0.44 

0.69 

-0.44 

0.00 

0.38 

1.11 

2G336 

-1.18 

69 

63 

0.44 

0.89 

-0.25 

0.49 

-0.85 

0.00 

0.37 

1.12 

2G337 

0.97 

98 

67 

0.24 

1.27 

2.16 

1.19 

1.03 

0.00 

0.26 

0.59 

2G338 

0.29 

81 

57 

0.26 

1.00 

0.01 

0.91 

-0.49 

0.00 

0.37 

1.04 

2G339 

2.11 

86 

34 

0.25 

1.45 

3.89 

1.61 

3.58 

0.00 

0.08 

-0.11 

2G34 

2.40 

69 

29 

0.27 

1.48 

3.78 

1.77 

3.76 

0.01 

0.05 

-0.24 

2G340 

1.00 

68 

46 

0.30 

1.25 

1.62 

1.21 

0.76 

0.01 

0.37 

0.64 

2G341 

-0.17 

67 

55 

0.36 

1.29 

1.40 

2.40 

2.37 

0.00 

0.17 

0.54 

2G342 

-1.54 

67 

64 

0.61 

0.93 

0.02 

0.35 

-0.54 

0.00 

0.32 

1.09 

2G35 

-0.56 

164 

140 

0.24 

1.05 

0.38 

1.18 

0.67 

0.00 

0.27 

0.92 

2G36 

-1.66 

72 

67 

0.48 

1.02 

0.17 

1.25 

0.55 

0.00 

0.19 

0.96 

2G37 

-0.13 

91 

75 

0.30 

1.26 

1.46 

1.36 

1.05 

0.00 

0.15 

0.70 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2G38 

0.32 

83 

60 

0.26 

1.23 

1.78 

1.41 

1.62 

0.00 

0.13 

0.53 

2G39 

0.29 

78 

55 

0.27 

0.99 

-0.08 

1.00 

0.05 

0.00 

0.40 

1.01 

2MD101 

1.61 

80 

50 

0.27 

1.10 

0.90 

1.13 

0.74 

0.00 

0.41 

0.79 

2MD1010 

0.10 

72 

51 

0.29 

0.90 

-0.78 

0.75 

-0.97 

0.00 

0.49 

1.23 

2MD1011 

0.27 

84 

62 

0.27 

0.95 

-0.32 

0.88 

-0.37 

0.00 

0.42 

1.09 

2MD1012 

1.43 

69 

36 

0.27 

0.74 

-2.61 

0.68 

-2.53 

0.00 

0.67 

1.71 

2MD1013 

1.89 

98 

50 

0.23 

1.23 

2.36 

1.35 

2.51 

0.00 

0.26 

0.37 

2MD1014 

0.10 

80 

59 

0.27 

0.98 

-0.10 

0.91 

-0.42 

0.00 

0.37 

1.05 

2MD1015 

0.27 

86 

64 

0.27 

0.96 

-0.25 

0.98 

-0.02 

0.00 

0.40 

1.06 

2MD102 

1.09 

156 

88 

0.18 

1.05 

0.68 

1.02 

0.23 

0.00 

0.43 

0.89 

2MD103 

1.51 

69 

41 

0.28 

0.77 

-2.15 

0.71 

-1.76 

0.01 

0.63 

1.55 

2MD104 

0.91 

68 

47 

0.31 

0.80 

-1.38 

0.78 

-0.67 

0.01 

0.61 

1.29 

2MD105 

0.30 

67 

51 

0.33 

0.72 

-1.76 

0.52 

-1.53 

0.00 

0.61 

1.39 

2MD106 

2.12 

67 

35 

0.28 

1.17 

1.46 

1.29 

1.64 

0.00 

0.38 

0.52 

2MD107 

-3.35 

71 

70 

1.02 

1.02 

0.34 

0.74 

0.21 

0.00 

0.09 

0.99 

2MD108 

-0.22 

91 

76 

0.31 

1.02 

0.17 

1.30 

0.88 

0.00 

0.30 

0.95 

2MD109 

-0.61 

83 

71 

0.33 

0.99 

0.00 

0.71 

-0.65 

0.00 

0.35 

1.06 

2MD21 

0.98 

78 

45 

0.26 

0.98 

-0.20 

0.95 

-0.25 

0.00 

0.45 

1.07 

2MD210 

-1.68 

80 

77 

0.61 

0.86 

-0.12 

0.88 

0.22 

0.00 

0.28 

1.05 

2MD211 

-0.20 

167 

139 

0.22 

1.04 

0.36 

1.02 

0.16 

0.00 

0.32 

0.95 

2MD212 

-1.47 

72 

65 

0.42 

1.01 

0.12 

0.97 

0.17 

0.00 

0.25 

0.99 

2MD22 

-0.51 

84 

71 

0.32 

0.91 

-0.40 

0.71 

-0.62 

0.00 

0.40 

1.11 

2MD23 

0.77 

69 

45 

0.28 

1.12 

1.07 

1.31 

1.51 

0.00 

0.29 

0.67 

2MD24 

0.72 

98 

71 

0.25 

1.07 

0.58 

1.23 

1.06 

0.00 

0.36 

0.85 

2MD25 

-0.30 

80 

64 

0.30 

0.86 

-0.82 

0.96 

-0.08 

0.00 

0.44 

1.15 

2MD26 

1.23 

86 

49 

0.24 

1.02 

0.28 

1.04 

0.33 

0.00 

0.41 

0.93 

2MD27 

0.29 

69 

55 

0.33 

1.08 

0.50 

0.92 

-0.10 

0.01 

0.34 

0.94 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2MD28 

-0.64 

68 

60 

0.41 

1.11 

0.50 

1.10 

0.38 

0.01 

0.32 

0.93 

2MD29 

0.40 

67 

50 

0.32 

0.94 

-0.30 

0.79 

-0.59 

0.00 

0.50 

1.11 

2MD31 

1.10 

67 

47 

0.31 

0.94 

-0.35 

0.82 

-0.71 

0.00 

0.52 

1.13 

2MD310 

-0.40 

71 

58 

0.33 

1.17 

0.94 

1.29 

0.82 

0.00 

0.21 

0.77 

2MD311 

-2.27 

170 

164 

0.42 

0.98 

0.06 

0.94 

0.09 

0.00 

0.16 

1.00 

2MD312 

-0.53 

91 

79 

0.33 

0.96 

-0.13 

0.96 

0.04 

0.00 

0.33 

1.02 

2MD313 

0.10 

83 

63 

0.28 

0.96 

-0.27 

0.84 

-0.56 

0.00 

0.40 

1.09 

2MD314 

0.44 

78 

53 

0.27 

1.11 

0.97 

1.02 

0.19 

0.00 

0.34 

0.82 

2MD315 

1.47 

80 

52 

0.27 

1.08 

0.68 

1.15 

0.77 

0.00 

0.42 

0.83 

2MD32 

1.73 

72 

30 

0.28 

1.30 

2.25 

1.45 

2.23 

0.00 

0.33 

0.35 

2MD33 

1.12 

84 

49 

0.25 

1.01 

0.18 

0.91 

-0.46 

0.00 

0.44 

1.02 

2MD34 

0.45 

69 

49 

0.29 

1.23 

1.78 

1.32 

1.31 

0.00 

0.18 

0.54 

2MD35 

-3.27 

98 

97 

1.02 

0.96 

0.28 

0.22 

-0.54 

0.00 

0.20 

1.06 

2MD36 

0.11 

79 

58 

0.27 

1.31 

2.21 

1.61 

2.68 

0.00 

-0.05 

0.38 

2MD37 

0.55 

86 

60 

0.26 

1.05 

0.45 

1.25 

1.22 

0.00 

0.33 

0.85 

2MD38 

1.35 

69 

43 

0.28 

1.10 

0.89 

1.19 

0.99 

0.01 

0.35 

0.73 

2MD39 

0.41 

68 

52 

0.33 

1.11 

0.68 

1.00 

0.15 

0.01 

0.41 

0.89 

2MD41 

1.34 

67 

40 

0.29 

1.02 

0.21 

0.97 

-0.06 

0.00 

0.50 

0.97 

2MD410 

1.19 

67 

46 

0.30 

0.82 

-1.27 

0.75 

-1.13 

0.00 

0.58 

1.31 

2MD411 

1.20 

71 

39 

0.27 

1.04 

0.42 

1.10 

0.65 

0.00 

0.41 

0.86 

2MD412 

1.00 

91 

59 

0.24 

0.94 

-0.61 

0.91 

-0.46 

0.00 

0.47 

1.14 

2MD413 

2.09 

83 

31 

0.25 

0.94 

-0.56 

0.90 

-0.60 

0.00 

0.47 

1.15 

2MD414 

1.50 

77 

37 

0.26 

0.93 

-0.71 

0.87 

-0.89 

0.00 

0.51 

1.23 

2MD415 

0.85 

80 

60 

0.29 

0.94 

-0.38 

1.14 

0.59 

0.00 

0.46 

1.04 

2MD42 

0.81 

72 

42 

0.28 

0.78 

-2.02 

0.69 

-1.87 

0.00 

0.61 

1.53 

2MD43 

2.10 

84 

33 

0.25 

0.89 

-1.09 

1.00 

0.03 

0.00 

0.53 

1.21 

2MD44 

2.25 

69 

25 

0.28 

0.82 

-1.48 

0.76 

-1.46 

0.00 

0.60 

1.37 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2MD45 

1.32 

138 

87 

0.20 

0.86 

-1.62 

0.77 

-1.52 

0.01 

0.59 

1.30 

2MD46 

0.65 

98 

72 

0.26 

0.94 

-0.44 

0.90 

-0.37 

0.00 

0.48 

1.09 

2MD47 

1.54 

79 

35 

0.24 

0.93 

-0.84 

0.90 

-0.88 

0.00 

0.45 

1.27 

2MD48 

0.41 

86 

62 

0.26 

0.78 

-1.88 

0.65 

-1.81 

0.00 

0.57 

1.41 

2MD49 

0.95 

69 

48 

0.29 

0.65 

-2.96 

0.51 

-2.39 

0.01 

0.70 

1.65 

2MD51 

0.46 

67 

51 

0.33 

0.78 

-1.40 

0.51 

-1.33 

0.01 

0.62 

1.34 

2MD510 

0.70 

67 

47 

0.31 

0.92 

-0.45 

0.89 

-0.33 

0.00 

0.51 

1.11 

2MD511 

1.95 

67 

37 

0.28 

1.05 

0.45 

1.18 

1.06 

0.00 

0.45 

0.82 

2MD512 

0.24 

135 

105 

0.24 

1.00 

0.07 

0.91 

-0.20 

0.01 

0.45 

1.01 

2MD513 

0.52 

71 

48 

0.28 

0.78 

-1.81 

0.66 

-1.70 

0.00 

0.61 

1.44 

2MD514 

0.04 

91 

73 

0.29 

0.88 

-0.70 

0.66 

-1.12 

0.00 

0.47 

1.18 

2MD515 

2.48 

83 

25 

0.26 

1.09 

0.77 

1.28 

1.39 

0.00 

0.30 

0.78 

2MD52 

0.92 

76 

45 

0.26 

0.87 

-1.31 

0.87 

-0.79 

0.00 

0.51 

1.33 

2MD53 

0.38 

80 

65 

0.32 

0.94 

-0.29 

0.98 

0.08 

0.00 

0.44 

1.05 

2MD54 

1.45 

71 

33 

0.28 

0.72 

-2.53 

0.65 

-2.33 

0.00 

0.67 

1.62 

2MD55 

0.81 

84 

54 

0.25 

0.82 

-1.83 

0.74 

-1.35 

0.00 

0.56 

1.43 

2MD56 

0.92 

69 

43 

0.27 

0.92 

-0.67 

0.82 

-1.04 

0.00 

0.50 

1.24 

2MD57 

1.20 

98 

63 

0.24 

0.91 

-0.77 

0.90 

-0.59 

0.00 

0.52 

1.16 

2MD58 

-0.48 

79 

65 

0.31 

1.00 

0.07 

0.85 

-0.47 

0.00 

0.33 

1.03 

2MD59 

0.41 

86 

62 

0.26 

0.84 

-1.35 

0.73 

-1.33 

0.00 

0.52 

1.30 

2MD61 

-0.47 

69 

61 

0.40 

0.89 

-0.33 

1.30 

0.68 

0.01 

0.33 

1.02 

2MD610 

-1.21 

67 

62 

0.50 

1.25 

0.78 

2.41 

1.47 

0.01 

0.12 

0.77 

2MD611 

-0.30 

67 

56 

0.37 

1.08 

0.47 

0.90 

-0.04 

0.00 

0.36 

0.94 

2MD612 

0.11 

67 

56 

0.37 

0.94 

-0.19 

0.68 

-0.72 

0.00 

0.45 

1.10 

2MD613 

-0.51 

70 

58 

0.34 

1.06 

0.37 

1.47 

1.16 

0.00 

0.25 

0.86 

2MD62 

1.23 

91 

55 

0.24 

0.87 

-1.36 

1.01 

0.12 

0.00 

0.52 

1.27 

2MD63 

0.52 

83 

57 

0.26 

0.90 

-0.90 

0.78 

-1.06 

0.00 

0.48 

1.25 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2MD64 

-0.59 

153 

131 

0.24 

1.12 

0.83 

1.17 

0.62 

0.00 

0.19 

0.86 

2MD65 

0.92 

76 

45 

0.26 

1.16 

1.60 

1.07 

0.50 

0.00 

0.32 

0.62 

2MD66 

0.17 

80 

67 

0.34 

0.73 

-1.40 

0.48 

-1.44 

0.00 

0.57 

1.29 

2MD67 

-0.06 

71 

52 

0.30 

0.90 

-0.72 

0.82 

-0.57 

0.00 

0.46 

1.18 

2MD68 

0.40 

142 

105 

0.22 

1.02 

0.27 

0.93 

-0.27 

0.00 

0.43 

0.99 

2MD69 

-0.13 

84 

67 

0.29 

0.85 

-0.94 

0.76 

-0.63 

0.00 

0.46 

1.19 

2MD71 

1.87 

69 

30 

0.27 

1.29 

2.38 

1.35 

2.26 

0.00 

0.20 

0.28 

2MD710 

1.25 

98 

62 

0.24 

1.03 

0.30 

0.94 

-0.31 

0.00 

0.45 

0.98 

2MD711 

2.62 

164 

51 

0.19 

1.32 

3.37 

2.01 

5.21 

0.00 

0.14 

0.26 

2MD712 

1.10 

77 

42 

0.25 

0.97 

-0.42 

0.98 

-0.14 

0.00 

0.39 

1.12 

2MD72 

0.95 

85 

53 

0.25 

1.16 

1.53 

1.26 

1.61 

0.00 

0.28 

0.57 

2MD73 

1.03 

69 

47 

0.29 

1.02 

0.17 

1.36 

1.47 

0.01 

0.38 

0.89 

2MD74 

3.35 

67 

19 

0.31 

1.07 

0.53 

2.13 

2.62 

0.01 

0.38 

0.73 

2MD75 

2.68 

67 

24 

0.30 

1.39 

2.73 

1.83 

2.71 

0.00 

0.25 

0.12 

2MD76 

0.36 

67 

54 

0.35 

0.96 

-0.12 

1.09 

0.35 

0.00 

0.41 

0.99 

2MD77 

0.10 

70 

52 

0.30 

1.08 

0.58 

1.05 

0.29 

0.00 

0.34 

0.88 

2MD78 

0.62 

91 

65 

0.26 

0.85 

-1.26 

0.76 

-1.08 

0.00 

0.52 

1.27 

2MD79 

1.26 

83 

45 

0.24 

1.02 

0.28 

1.05 

0.40 

0.00 

0.38 

0.91 

2MD81 

0.04 

76 

57 

0.29 

0.83 

-1.23 

0.67 

-1.29 

0.00 

0.51 

1.30 

2MD810 

0.93 

80 

59 

0.29 

0.93 

-0.45 

0.99 

0.07 

0.00 

0.49 

1.11 

2MD811 

-0.77 

71 

59 

0.34 

0.83 

-0.89 

0.58 

-1.00 

0.00 

0.44 

1.23 

2MD812 

0.12 

84 

64 

0.28 

1.10 

0.74 

0.96 

-0.04 

0.00 

0.32 

0.89 

2MD813 

0.84 

69 

44 

0.28 

1.06 

0.53 

1.21 

1.12 

0.00 

0.34 

0.79 

2MD82 

0.31 

98 

77 

0.27 

1.06 

0.46 

0.97 

-0.04 

0.00 

0.38 

0.95 

2MD83 

-0.71 

77 

66 

0.34 

0.85 

-0.61 

0.64 

-1.10 

0.00 

0.46 

1.16 

2MD84 

0.13 

85 

65 

0.28 

0.85 

-1.07 

0.69 

-1.28 

0.00 

0.50 

1.25 

2MD85 

0.69 

69 

51 

0.30 

1.10 

0.69 

1.13 

0.52 

0.01 

0.33 

0.84 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2MD86 

-0.28 

67 

57 

0.38 

0.99 

0.02 

0.65 

-0.46 

0.01 

0.44 

1.07 

2MD87 

1.40 

161 

81 

0.18 

0.98 

-0.37 

1.01 

0.13 

0.00 

0.44 

1.05 

2MD88 

-0.30 

67 

56 

0.37 

0.70 

-1.57 

0.38 

-1.50 

0.00 

0.58 

1.35 

2MD89 

0.54 

66 

52 

0.34 

0.83 

-0.89 

0.60 

-1.28 

0.00 

0.55 

1.25 

2MD91 

-1.87 

70 

66 

0.53 

1.11 

0.39 

2.36 

1.50 

0.00 

0.04 

0.86 

2MD910 

2.87 

91 

27 

0.26 

1.23 

1.80 

1.64 

2.58 

0.00 

0.23 

0.51 

2MD911 

1.09 

82 

47 

0.24 

1.31 

3.34 

1.46 

2.72 

0.00 

0.10 

-0.08 

2MD912 

2.20 

158 

68 

0.19 

1.35 

4.01 

1.70 

4.66 

0.00 

0.24 

0.13 

2MD913 

2.06 

76 

28 

0.27 

0.91 

-0.78 

0.92 

-0.44 

0.00 

0.52 

1.19 

2MD914 

1.17 

80 

56 

0.28 

1.26 

1.85 

1.38 

1.53 

0.00 

0.29 

0.56 

2MD915 

2.86 

69 

17 

0.34 

0.91 

-0.48 

1.01 

0.16 

0.00 

0.58 

1.09 

2MD92 

-0.41 

84 

70 

0.31 

0.94 

-0.29 

0.66 

-0.81 

0.00 

0.41 

1.11 

2MD93 

0.28 

69 

51 

0.30 

0.98 

-0.14 

0.89 

-0.36 

0.00 

0.40 

1.06 

2MD94 

1.74 

98 

53 

0.23 

1.09 

0.99 

1.14 

1.06 

0.00 

0.38 

0.76 

2MD95 

1.95 

77 

28 

0.25 

1.16 

1.60 

1.22 

1.53 

0.00 

0.16 

0.52 

2MD96 

0.06 

85 

66 

0.28 

0.93 

-0.47 

0.81 

-0.66 

0.00 

0.42 

1.12 

2MD97 

2.17 

69 

32 

0.27 

0.87 

-1.17 

0.80 

-1.32 

0.01 

0.57 

1.35 

2MD98 

4.71 

67 

8 

0.41 

1.24 

0.92 

2.55 

1.80 

0.01 

0.15 

0.68 

2MD99 

-0.44 

67 

57 

0.38 

0.82 

-0.82 

0.60 

-0.70 

0.00 

0.49 

1.19 

2NBT21 

-0.88 

66 

61 

0.49 

0.84 

-0.37 

0.49 

-0.62 

0.00 

0.41 

1.13 

2NBT210 

0.00 

70 

70 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

2NBT211 

-0.76 

91 

81 

0.36 

0.75 

-1.08 

0.42 

-1.35 

0.00 

0.49 

1.22 

2NBT212 

-0.98 

82 

73 

0.37 

0.93 

-0.21 

0.67 

-0.59 

0.00 

0.35 

1.08 

2NBT213 

-1.00 

76 

67 

0.37 

0.85 

-0.54 

1.21 

0.57 

0.00 

0.35 

1.09 

2NBT214 

-0.50 

80 

72 

0.40 

0.95 

-0.11 

0.72 

-0.33 

0.00 

0.37 

1.05 

2NBT215 

-0.95 

69 

59 

0.37 

0.97 

-0.08 

0.79 

-0.30 

0.00 

0.34 

1.04 

2NBT216 

-1.93 

84 

80 

0.53 

1.04 

0.24 

0.75 

-0.08 

0.00 

0.18 

0.99 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2NBT217 

-1.18 

69 

63 

0.44 

0.95 

-0.06 

0.72 

-0.30 

0.00 

0.29 

1.06 

2NBT218 

-1.00 

98 

90 

0.39 

0.87 

-0.41 

0.54 

-0.80 

0.00 

0.41 

1.11 

2NBT219 

-0.83 

77 

67 

0.35 

0.89 

-0.41 

0.67 

-0.91 

0.00 

0.41 

1.12 

2NBT22 

-1.51 

161 

149 

0.31 

0.83 

-0.69 

0.45 

-1.41 

0.00 

0.40 

1.14 

2NBT220 

0.63 

85 

58 

0.26 

0.97 

-0.22 

0.97 

-0.12 

0.00 

0.42 

1.05 

2NBT23 

-0.58 

264 

226 

0.19 

0.90 

-0.89 

0.68 

-1.56 

0.00 

0.42 

1.12 

2NBT24 

-0.32 

69 

60 

0.38 

0.90 

-0.36 

0.62 

-0.71 

0.01 

0.43 

1.12 

2NBT25 

-0.98 

67 

61 

0.46 

0.76 

-0.73 

0.38 

-0.77 

0.01 

0.47 

1.20 

2NBT26 

0.80 

67 

46 

0.31 

0.81 

-1.24 

0.74 

-0.98 

0.00 

0.58 

1.29 

2NBT27 

-1.15 

66 

62 

0.54 

0.96 

0.04 

0.47 

-0.50 

0.00 

0.33 

1.07 

2NBT28 

-1.40 

70 

64 

0.45 

0.81 

-0.51 

0.44 

-0.90 

0.00 

0.44 

1.16 

2NBT29 

-2.59 

91 

89 

0.73 

0.91 

0.08 

0.25 

-0.75 

0.00 

0.26 

1.09 

2NBT31 

-0.61 

82 

70 

0.33 

0.81 

-0.87 

0.76 

-0.52 

0.00 

0.44 

1.16 

2NBT310 

0.04 

76 

57 

0.29 

0.99 

-0.04 

0.85 

-0.48 

0.00 

0.39 

1.05 

2NBT311 

0.05 

80 

68 

0.35 

0.90 

-0.42 

0.86 

-0.19 

0.00 

0.43 

1.08 

2NBT312 

-0.95 

69 

59 

0.37 

0.98 

0.00 

0.73 

-0.44 

0.00 

0.34 

1.05 

2NBT313 

-1.43 

153 

142 

0.33 

0.91 

-0.29 

0.66 

-0.47 

0.00 

0.33 

1.08 

2NBT314 

-0.98 

84 

75 

0.37 

0.83 

-0.60 

0.53 

-0.86 

0.00 

0.42 

1.15 

2NBT315 

-1.00 

69 

62 

0.41 

0.91 

-0.20 

0.52 

-0.87 

0.00 

0.37 

1.11 

2NBT316 

-0.01 

98 

81 

0.29 

0.98 

-0.05 

0.92 

-0.14 

0.00 

0.40 

1.02 

2NBT317 

-1.07 

75 

67 

0.39 

0.93 

-0.17 

0.72 

-0.59 

0.00 

0.35 

1.07 

2NBT318 

-0.70 

85 

74 

0.34 

0.99 

0.05 

0.97 

0.07 

0.00 

0.29 

1.00 

2NBT319 

-1.31 

69 

65 

0.53 

0.99 

0.11 

0.85 

0.09 

0.01 

0.23 

1.01 

2NBT32 

-1.37 

66 

62 

0.54 

0.82 

-0.34 

0.36 

-0.63 

0.01 

0.39 

1.14 

2NBT320 

-1.13 

67 

61 

0.46 

0.88 

-0.30 

0.45 

-0.68 

0.00 

0.40 

1.14 

2NBT33 

0.76 

66 

50 

0.33 

1.00 

0.03 

0.99 

0.08 

0.00 

0.44 

1.00 

2NBT34 

-0.08 

70 

54 

0.31 

0.94 

-0.33 

0.94 

-0.08 

0.00 

0.43 

1.08 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2NBT35 

0.04 

91 

73 

0.29 

0.80 

-1.29 

0.63 

-1.26 

0.00 

0.52 

1.26 

2NBT36 

-0.51 

82 

69 

0.32 

0.81 

-0.95 

0.61 

-1.06 

0.00 

0.47 

1.20 

2NBT37 

0.90 

157 

105 

0.19 

0.98 

-0.27 

0.88 

-0.82 

0.00 

0.46 

1.09 

2NBT38 

0.04 

76 

57 

0.29 

0.88 

-0.84 

0.73 

-1.02 

0.00 

0.47 

1.22 

2NBT39 

-0.20 

80 

70 

0.37 

0.93 

-0.23 

0.56 

-0.89 

0.00 

0.44 

1.12 

2NBT51 

-2.06 

69 

65 

0.53 

1.06 

0.28 

0.80 

0.02 

0.00 

0.18 

0.97 

2NBT52 

0.04 

84 

65 

0.28 

0.89 

-0.73 

0.75 

-0.78 

0.00 

0.46 

1.18 

2NBT53 

-0.10 

69 

55 

0.32 

0.87 

-0.78 

0.63 

-1.20 

0.00 

0.48 

1.23 

2NBT54 

-0.39 

98 

85 

0.32 

0.85 

-0.71 

0.57 

-1.13 

0.00 

0.50 

1.17 

2NBT55 

0.00 

75 

57 

0.29 

0.97 

-0.14 

0.87 

-0.54 

0.00 

0.37 

1.07 

2NBT61 

-0.48 

156 

135 

0.25 

0.97 

-0.11 

1.16 

0.58 

0.00 

0.30 

0.99 

2NBT610 

0.61 

153 

104 

0.19 

0.83 

-2.16 

0.73 

-1.82 

0.00 

0.54 

1.37 

2NBT611 

0.36 

85 

62 

0.27 

1.05 

0.47 

1.09 

0.48 

0.00 

0.33 

0.90 

2NBT612 

-0.18 

69 

59 

0.37 

1.05 

0.30 

0.84 

-0.20 

0.01 

0.32 

0.99 

2NBT613 

-1.37 

66 

62 

0.54 

1.12 

0.41 

0.83 

0.11 

0.01 

0.21 

0.94 

2NBT614 

1.07 

67 

43 

0.30 

0.82 

-1.29 

0.71 

-1.33 

0.00 

0.60 

1.34 

2NBT615 

0.17 

66 

55 

0.37 

1.12 

0.60 

1.12 

0.41 

0.00 

0.33 

0.91 

2NBT616 

-0.18 

70 

55 

0.32 

0.94 

-0.29 

0.94 

-0.08 

0.00 

0.41 

1.06 

2NBT617 

0.20 

91 

71 

0.28 

0.98 

-0.11 

0.75 

-0.86 

0.00 

0.42 

1.09 

2NBT618 

-0.05 

82 

64 

0.29 

0.92 

-0.49 

0.80 

-0.65 

0.00 

0.42 

1.14 

2NBT619 

-0.51 

76 

63 

0.33 

0.90 

-0.47 

0.95 

-0.02 

0.00 

0.37 

1.08 

2NBT62 

0.58 

80 

63 

0.31 

1.22 

1.29 

1.62 

1.73 

0.00 

0.24 

0.64 

2NBT620 

0.70 

69 

42 

0.28 

0.98 

-0.16 

1.06 

0.37 

0.00 

0.47 

1.02 

2NBT63 

-0.61 

84 

72 

0.33 

1.04 

0.25 

0.86 

-0.17 

0.00 

0.29 

0.98 

2NBT64 

0.28 

69 

51 

0.30 

1.04 

0.34 

1.25 

0.97 

0.00 

0.30 

0.87 

2NBT65 

1.32 

97 

60 

0.24 

1.06 

0.61 

1.08 

0.56 

0.00 

0.41 

0.87 

2NBT66 

0.72 

75 

47 

0.26 

1.08 

0.90 

1.19 

1.36 

0.00 

0.23 

0.68 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2NBT67 

0.76 

85 

56 

0.25 

0.94 

-0.58 

0.85 

-0.86 

0.00 

0.47 

1.17 

2NBT68 

1.20 

69 

45 

0.28 

1.08 

0.66 

0.97 

-0.08 

0.01 

0.40 

0.89 

2NBT69 

0.44 

66 

51 

0.33 

1.10 

0.66 

1.18 

0.55 

0.01 

0.38 

0.84 

2NBT71 

1.42 

67 

39 

0.29 

0.76 

-2.01 

0.64 

-2.01 

0.00 

0.65 

1.52 

2NBT710 

2.43 

66 

31 

0.28 

1.16 

1.42 

1.22 

1.20 

0.00 

0.39 

0.57 

2NBT711 

2.09 

70 

26 

0.28 

0.89 

-0.94 

0.89 

-0.55 

0.00 

0.53 

1.22 

2NBT712 

1.63 

91 

48 

0.24 

1.03 

0.34 

1.10 

0.71 

0.00 

0.42 

0.88 

2NBT713 

2.10 

82 

30 

0.25 

1.31 

2.74 

1.68 

3.67 

0.00 

0.09 

0.14 

2NBT714 

0.81 

135 

94 

0.22 

1.07 

0.66 

0.94 

-0.21 

0.01 

0.47 

0.94 

2NBT715 

1.99 

76 

29 

0.27 

1.10 

0.92 

1.38 

2.11 

0.00 

0.33 

0.65 

2NBT716 

1.32 

80 

54 

0.27 

1.19 

1.48 

1.35 

1.56 

0.00 

0.33 

0.62 

2NBT717 

0.37 

69 

46 

0.29 

0.91 

-0.71 

0.90 

-0.39 

0.00 

0.49 

1.17 

2NBT718 

2.63 

84 

25 

0.27 

0.80 

-1.61 

0.98 

-0.03 

0.00 

0.58 

1.28 

2NBT719 

2.02 

69 

28 

0.27 

1.36 

2.81 

1.51 

2.97 

0.00 

0.12 

0.12 

2NBT72 

1.91 

97 

49 

0.23 

0.96 

-0.46 

0.95 

-0.36 

0.00 

0.49 

1.12 

2NBT720 

1.72 

75 

31 

0.25 

1.00 

0.08 

0.98 

-0.16 

0.00 

0.36 

1.00 

2NBT73 

0.06 

85 

66 

0.28 

0.97 

-0.18 

1.11 

0.47 

0.00 

0.38 

1.04 

2NBT74 

0.29 

69 

55 

0.33 

1.07 

0.47 

0.90 

-0.17 

0.01 

0.34 

0.95 

2NBT75 

1.94 

66 

35 

0.29 

0.80 

-1.55 

0.75 

-1.23 

0.01 

0.65 

1.37 

2NBT76 

0.80 

67 

46 

0.31 

1.05 

0.39 

0.90 

-0.28 

0.00 

0.47 

0.97 

2NBT77 

1.44 

66 

43 

0.30 

1.15 

1.11 

1.13 

0.69 

0.00 

0.38 

0.72 

2NBT78 

1.14 

70 

39 

0.27 

1.04 

0.39 

0.97 

-0.16 

0.00 

0.44 

0.95 

2NBT79 

1.40 

91 

52 

0.24 

1.09 

0.99 

1.14 

0.93 

0.00 

0.37 

0.73 

2NBT81 

0.85 

82 

51 

0.25 

1.04 

0.50 

1.00 

0.03 

0.00 

0.35 

0.90 

2NBT810 

0.04 

76 

57 

0.29 

0.80 

-1.48 

0.64 

-1.44 

0.00 

0.53 

1.35 

2NBT811 

-1.08 

80 

75 

0.49 

0.89 

-0.17 

0.49 

-0.53 

0.00 

0.36 

1.09 

2NBT812 

-0.95 

69 

59 

0.37 

1.06 

0.35 

1.42 

0.93 

0.00 

0.26 

0.91 
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Item  ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2NBT813 

0.04 

84 

65 

0.28 

0.84 

-1.09 

0.63 

-1.26 

0.00 

0.51 

1.26 

2NBT814 

-1.00 

69 

62 

0.41 

1.00 

0.11 

0.76 

-0.29 

0.00 

0.27 

1.02 

2NBT815 

-1.00 

97 

89 

0.39 

0.92 

-0.19 

0.83 

-0.12 

0.00 

0.35 

1.05 

2NBT816 

-0.14 

74 

58 

0.30 

0.92 

-0.48 

0.85 

-0.57 

0.00 

0.41 

1.12 

2NBT817 

-0.38 

85 

71 

0.31 

0.88 

-0.62 

0.72 

-0.79 

0.00 

0.42 

1.14 

2NBT818 

-0.18 

69 

59 

0.37 

0.83 

-0.72 

0.54 

-1.02 

0.01 

0.49 

1.20 

2NBT819 

-0.87 

66 

60 

0.46 

0.83 

-0.46 

0.42 

-0.69 

0.01 

0.44 

1.16 

2NBT82 

-1.39 

141 

131 

0.34 

1.03 

0.22 

0.91 

0.02 

0.00 

0.24 

0.99 

2NBT820 

-0.59 

67 

58 

0.39 

0.91 

-0.30 

0.55 

-0.74 

0.00 

0.44 

1.13 

2NBT83 

-0.12 

66 

57 

0.39 

0.88 

-0.43 

0.75 

-0.40 

0.00 

0.44 

1.11 

2NBT84 

-0.08 

70 

54 

0.31 

1.07 

0.50 

0.91 

-0.18 

0.00 

0.36 

0.94 

2NBT85 

0.20 

91 

71 

0.28 

1.04 

0.32 

1.37 

1.23 

0.00 

0.30 

0.87 

2NBT86 

0.13 

80 

60 

0.28 

0.88 

-0.88 

0.71 

-1.11 

0.00 

0.47 

1.24 

2NBT87 

1.18 

76 

41 

0.26 

0.93 

-0.69 

0.86 

-1.00 

0.00 

0.50 

1.24 

2NBT88 

2.22 

80 

41 

0.26 

1.23 

2.06 

1.56 

3.00 

0.00 

0.32 

0.35 

2NBT89 

0.46 

69 

45 

0.29 

0.89 

-0.85 

0.81 

-0.85 

0.00 

0.51 

1.24 

2NBT91 

-0.41 

84 

70 

0.31 

0.82 

-1.00 

0.56 

-1.15 

0.00 

0.49 

1.23 

2NBT910 

1.36 

69 

37 

0.27 

0.88 

-1.10 

0.89 

-0.75 

0.00 

0.53 

1.29 

2NBT911 

0.66 

97 

71 

0.26 

1.11 

0.86 

1.20 

0.93 

0.00 

0.34 

0.82 

2NBT912 

0.95 

74 

43 

0.25 

1.07 

0.86 

1.06 

0.54 

0.00 

0.28 

0.75 

2NBT913 

-0.59 

85 

73 

0.33 

0.77 

-1.15 

0.46 

-1.64 

0.00 

0.51 

1.26 

2NBT914 

-1.31 

69 

65 

0.53 

1.10 

0.37 

0.94 

0.20 

0.01 

0.16 

0.94 

2NBT915 

1.50 

66 

40 

0.30 

1.22 

1.50 

1.18 

0.78 

0.01 

0.40 

0.64 

2NBT916 

-0.75 

67 

59 

0.41 

0.89 

-0.36 

0.94 

0.11 

0.00 

0.39 

1.07 

2NBT917 

-0.46 

66 

59 

0.43 

0.86 

-0.43 

0.46 

-0.96 

0.00 

0.45 

1.16 

2NBT918 

-0.76 

70 

60 

0.37 

1.01 

0.12 

1.08 

0.31 

0.00 

0.30 

0.97 

2NBT919 

-0.53 

90 

78 

0.33 

0.80 

-0.92 

0.53 

-1.17 

0.00 

0.48 

1.20 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

2NBT92 

0.13 

80 

60 

0.28 

0.97 

-0.21 

0.81 

-0.66 

0.00 

0.40 

1.10 

2NBT920 

0.04 

76 

57 

0.29 

0.85 

-1.05 

1.13 

0.54 

0.00 

0.44 

1.17 

2NBT93 

0.05 

80 

68 

0.35 

0.83 

-0.81 

0.58 

-1.00 

0.00 

0.50 

1.19 

2NBT94 

0.15 

174 

134 

0.20 

0.97 

-0.29 

0.88 

-0.57 

0.00 

0.40 

1.07 

2NBT95 

1.18 

69 

36 

0.28 

1.13 

1.12 

1.11 

0.71 

0.00 

0.42 

0.71 

2NBT96 

0.34 

84 

61 

0.27 

0.86 

-1.14 

0.72 

-1.07 

0.00 

0.51 

1.27 

2NBT97 

0.36 

69 

50 

0.29 

0.78 

-1.83 

0.71 

-1.19 

0.00 

0.57 

1.40 

2NBT98 

0.85 

97 

68 

0.25 

0.85 

-1.28 

0.71 

-1.56 

0.00 

0.58 

1.28 

2NBT99 

-0.77 

74 

64 

0.36 

1.03 

0.19 

1.14 

0.50 

0.00 

0.21 

0.96 

20A11 

2.08 

85 

34 

0.25 

0.86 

-1.37 

0.81 

-1.36 

0.00 

0.56 

1.34 

20A12 

0.07 

69 

57 

0.34 

0.99 

0.01 

0.77 

-0.49 

0.01 

0.39 

1.05 

20A13 

1.23 

66 

43 

0.30 

1.12 

0.87 

1.12 

0.52 

0.01 

0.43 

0.79 

20A14 

0.84 

66 

45 

0.31 

0.94 

-0.35 

0.84 

-0.53 

0.00 

0.53 

1.11 

20A15 

1.44 

66 

43 

0.30 

1.04 

0.32 

1.06 

0.35 

0.00 

0.45 

0.91 

20A21 

0.61 

70 

46 

0.28 

0.88 

-0.97 

0.76 

-1.19 

0.00 

0.54 

1.28 

2OA210 

-0.64 

90 

79 

0.34 

1.06 

0.35 

0.93 

0.00 

0.00 

0.27 

0.97 

20A211 

-0.71 

80 

69 

0.34 

0.99 

0.03 

0.81 

-0.33 

0.00 

0.32 

1.04 

20A212 

-0.62 

76 

64 

0.33 

0.88 

-0.55 

0.83 

-0.32 

0.00 

0.39 

1.12 

20A213 

-0.20 

80 

70 

0.37 

0.82 

-0.71 

0.45 

-1.24 

0.00 

0.50 

1.20 

20A214 

1.99 

69 

26 

0.29 

1.18 

1.29 

1.25 

1.18 

0.00 

0.42 

0.65 

20A215 

2.78 

84 

23 

0.27 

1.45 

2.87 

1.70 

2.57 

0.00 

0.08 

0.29 

20A216 

0.19 

69 

52 

0.30 

0.98 

-0.07 

0.91 

-0.25 

0.00 

0.38 

1.04 

20A217 

-1.16 

97 

90 

0.41 

1.01 

0.12 

0.77 

-0.19 

0.00 

0.29 

1.01 

20A218 

0.08 

73 

55 

0.29 

0.97 

-0.18 

0.94 

-0.23 

0.00 

0.35 

1.05 

20A219 

-0.11 

85 

68 

0.29 

0.79 

-1.38 

0.59 

-1.54 

0.00 

0.52 

1.29 

20A22 

0.59 

69 

52 

0.31 

1.03 

0.22 

0.87 

-0.36 

0.01 

0.40 

1.00 

2OA220 

-0.50 

66 

58 

0.41 

1.00 

0.10 

0.73 

-0.21 

0.01 

0.38 

1.04 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

20A221 

-0.57 

66 

57 

0.40 

1.14 

0.66 

1.20 

0.51 

0.00 

0.28 

0.85 

20A222 

-0.12 

66 

57 

0.39 

1.18 

0.78 

1.33 

0.77 

0.00 

0.23 

0.80 

20A223 

0.58 

158 

114 

0.20 

0.96 

-0.39 

0.83 

-0.88 

0.00 

0.47 

1.10 

20A224 

-0.29 

70 

56 

0.32 

1.05 

0.36 

1.20 

0.66 

0.00 

0.31 

0.90 

20A225 

-0.53 

90 

78 

0.33 

0.85 

-0.66 

0.71 

-0.61 

0.00 

0.42 

1.13 

20A226 

-1.27 

80 

73 

0.41 

0.90 

-0.22 

0.54 

-0.77 

0.00 

0.36 

1.10 

20A227 

-2.53 

135 

132 

0.60 

1.03 

0.23 

1.99 

1.15 

0.00 

0.08 

0.93 

20A228 

-1.14 

76 

68 

0.39 

0.84 

-0.55 

0.47 

-1.10 

0.00 

0.42 

1.17 

20A229 

0.67 

80 

62 

0.30 

1.05 

0.34 

0.90 

-0.24 

0.00 

0.41 

0.97 

20A23 

-1.24 

69 

61 

0.40 

0.89 

-0.35 

0.54 

-0.77 

0.00 

0.37 

1.14 

2OA230 

-2.67 

84 

82 

0.73 

1.00 

0.22 

0.46 

-0.35 

0.00 

0.18 

1.03 

20A231 

-2.06 

194 

186 

0.37 

1.03 

0.21 

2.03 

1.63 

0.00 

0.09 

0.93 

20A232 

-1.00 

69 

62 

0.41 

1.13 

0.52 

1.44 

0.88 

0.00 

0.08 

0.85 

20A233 

-1.00 

97 

89 

0.39 

0.99 

0.06 

1.10 

0.36 

0.00 

0.29 

1.00 

20A234 

-1.80 

73 

69 

0.53 

0.90 

-0.08 

0.55 

-0.61 

0.00 

0.33 

1.07 

20A235 

-1.09 

85 

77 

0.39 

1.01 

0.13 

0.96 

0.10 

0.00 

0.25 

1.00 

20A236 

-0.64 

69 

62 

0.42 

0.97 

0.01 

1.22 

0.55 

0.01 

0.29 

1.00 

20A237 

-0.34 

66 

57 

0.39 

0.91 

-0.30 

0.61 

-0.50 

0.01 

0.44 

1.11 

20A238 

-1.11 

66 

60 

0.46 

1.10 

0.42 

1.17 

0.46 

0.00 

0.25 

0.92 

20A239 

-1.48 

66 

63 

0.62 

0.87 

-0.12 

0.33 

-0.59 

0.00 

0.35 

1.11 

20A24 

-0.51 

70 

58 

0.34 

0.91 

-0.43 

0.65 

-0.89 

0.00 

0.45 

1.14 

2OA240 

-0.98 

89 

81 

0.39 

0.83 

-0.55 

0.45 

-1.07 

0.00 

0.42 

1.16 

20A25 

0.05 

80 

61 

0.28 

0.90 

-0.70 

0.72 

-1.03 

0.00 

0.45 

1.20 

20A26 

-0.22 

76 

60 

0.30 

0.98 

-0.06 

1.13 

0.52 

0.00 

0.33 

0.99 

20A27 

0.38 

80 

65 

0.32 

0.98 

-0.06 

0.82 

-0.41 

0.00 

0.43 

1.05 

20A28 

0.54 

69 

44 

0.29 

1.03 

0.28 

1.03 

0.21 

0.00 

0.43 

0.93 

20A29 

-0.13 

84 

67 

0.29 

1.03 

0.26 

0.93 

-0.10 

0.00 

0.34 

0.97 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

20A31 

1.07 

69 

41 

0.27 

1.01 

0.17 

0.92 

-0.48 

0.00 

0.43 

1.02 

2OA310 

-2.12 

97 

94 

0.60 

1.06 

0.28 

1.69 

0.93 

0.00 

0.10 

0.94 

20A311 

-0.01 

73 

56 

0.29 

0.89 

-0.68 

0.78 

-0.97 

0.00 

0.45 

1.19 

20A312 

-0.11 

85 

68 

0.29 

0.94 

-0.32 

0.95 

-0.08 

0.00 

0.38 

1.06 

20A313 

-0.05 

69 

58 

0.35 

0.96 

-0.13 

0.73 

-0.53 

0.01 

0.40 

1.07 

20A314 

-0.05 

66 

55 

0.37 

0.95 

-0.18 

0.53 

-0.85 

0.01 

0.48 

1.14 

20A315 

0.44 

66 

49 

0.33 

0.87 

-0.75 

0.67 

-1.02 

0.00 

0.55 

1.22 

20A316 

1.16 

66 

46 

0.31 

0.85 

-1.01 

0.77 

-0.98 

0.00 

0.56 

1.26 

20A317 

-1.05 

70 

62 

0.40 

1.00 

0.08 

0.74 

-0.36 

0.00 

0.32 

1.03 

20A318 

0.17 

89 

70 

0.28 

1.00 

0.05 

0.86 

-0.42 

0.00 

0.38 

1.03 

20A319 

-0.18 

140 

115 

0.24 

1.00 

0.02 

0.85 

-0.43 

0.00 

0.40 

1.02 

20A32 

0.28 

173 

125 

0.18 

1.02 

0.30 

0.94 

-0.39 

0.00 

0.35 

0.99 

2OA320 

1.25 

80 

43 

0.25 

1.00 

0.08 

1.04 

0.31 

0.00 

0.39 

0.96 

20A321 

-0.10 

75 

58 

0.30 

1.02 

0.16 

0.86 

-0.42 

0.00 

0.36 

1.02 

20A322 

0.28 

80 

66 

0.33 

0.96 

-0.18 

0.81 

-0.41 

0.00 

0.44 

1.07 

20A323 

0.02 

69 

50 

0.30 

1.00 

0.05 

1.06 

0.31 

0.00 

0.40 

0.96 

20A324 

0.68 

84 

56 

0.26 

0.87 

-1.24 

0.76 

-1.14 

0.00 

0.52 

1.31 

20A325 

1.07 

69 

41 

0.27 

1.00 

0.02 

0.89 

-0.63 

0.00 

0.45 

1.07 

20A326 

-0.60 

97 

86 

0.34 

0.89 

-0.43 

0.85 

-0.19 

0.00 

0.42 

1.09 

20A327 

1.00 

73 

42 

0.25 

1.06 

0.78 

1.14 

1.16 

0.00 

0.26 

0.70 

20A328 

0.36 

85 

62 

0.27 

1.07 

0.59 

1.03 

0.22 

0.00 

0.33 

0.89 

20A329 

0.07 

69 

57 

0.34 

0.93 

-0.31 

0.74 

-0.57 

0.01 

0.43 

1.10 

20  A3  3 

0.44 

66 

51 

0.33 

0.84 

-0.95 

0.59 

-1.01 

0.01 

0.56 

1.25 

2OA330 

-0.57 

66 

57 

0.40 

0.90 

-0.37 

0.58 

-0.66 

0.00 

0.45 

1.14 

20A331 

-0.28 

66 

58 

0.41 

1.10 

0.45 

0.81 

-0.21 

0.00 

0.32 

0.97 

20A332 

-0.63 

70 

59 

0.35 

0.78 

-1.09 

0.52 

-1.25 

0.00 

0.53 

1.25 

20A333 

0.47 

89 

66 

0.27 

0.82 

-1.41 

0.65 

-1.54 

0.00 

0.53 

1.32 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

20A334 

-0.23 

153 

126 

0.24 

1.07 

0.60 

1.06 

0.29 

0.00 

0.36 

0.93 

20A335 

-1.90 

80 

76 

0.53 

0.85 

-0.22 

0.39 

-0.86 

0.00 

0.36 

1.12 

20A336 

0.32 

75 

53 

0.28 

1.11 

0.89 

1.09 

0.48 

0.00 

0.31 

0.81 

20A337 

-0.86 

80 

74 

0.45 

1.00 

0.11 

0.86 

0.02 

0.00 

0.30 

1.01 

20A338 

-1.41 

69 

62 

0.42 

0.93 

-0.14 

0.63 

-0.48 

0.00 

0.32 

1.08 

20A339 

0.15 

153 

116 

0.20 

0.82 

-1.91 

0.64 

-1.95 

0.00 

0.53 

1.32 

20A34 

0.65 

153 

103 

0.19 

0.99 

-0.13 

0.98 

-0.09 

0.00 

0.42 

1.04 

2OA340 

-0.38 

97 

84 

0.32 

0.96 

-0.15 

1.29 

0.80 

0.00 

0.36 

1.01 

20A35 

0.60 

73 

48 

0.26 

1.08 

0.84 

1.22 

1.40 

0.00 

0.22 

0.71 

20A36 

-0.70 

85 

74 

0.34 

0.87 

-0.54 

0.56 

-1.12 

0.00 

0.42 

1.16 

20A37 

-0.32 

69 

60 

0.38 

0.89 

-0.37 

0.67 

-0.57 

0.01 

0.42 

1.11 

20A38 

0.21 

66 

53 

0.35 

0.86 

-0.76 

0.69 

-0.58 

0.01 

0.52 

1.18 

20A39 

-0.01 

66 

53 

0.35 

0.65 

-2.00 

0.41 

-1.66 

0.00 

0.62 

1.42 

20A41 

-1.93 

66 

64 

0.74 

0.84 

-0.05 

0.21 

-0.68 

0.00 

0.33 

1.13 

2OA410 

-1.40 

70 

64 

0.45 

0.79 

-0.61 

0.37 

-1.10 

0.00 

0.47 

1.19 

20A411 

-1.14 

89 

82 

0.41 

0.93 

-0.13 

0.65 

-0.47 

0.00 

0.32 

1.07 

20A412 

-4.21 

156 

155 

1.01 

0.97 

0.30 

0.22 

-0.90 

0.00 

0.14 

1.05 

20A413 

-0.12 

80 

63 

0.29 

1.02 

0.15 

0.99 

0.06 

0.00 

0.32 

0.99 

20A414 

1.23 

75 

40 

0.26 

1.12 

1.26 

1.25 

1.66 

0.00 

0.32 

0.56 

20A415 

-0.34 

80 

71 

0.39 

0.93 

-0.18 

0.78 

-0.25 

0.00 

0.39 

1.05 

20A416 

-1.24 

69 

61 

0.40 

0.91 

-0.26 

0.63 

-0.55 

0.00 

0.35 

1.10 

20A417 

-1.68 

84 

79 

0.48 

0.88 

-0.21 

0.94 

0.15 

0.00 

0.29 

1.06 

20A418 

-2.38 

69 

67 

0.73 

0.98 

0.19 

0.53 

-0.18 

0.00 

0.19 

1.03 

20A419 

-1.33 

174 

161 

0.30 

0.97 

-0.05 

0.83 

-0.26 

0.00 

0.26 

1.02 

20A42 

-2.55 

97 

95 

0.73 

0.89 

0.05 

0.20 

-0.80 

0.00 

0.30 

1.10 

2OA420 

0.74 

73 

46 

0.26 

1.12 

1.23 

1.26 

1.76 

0.00 

0.18 

0.56 

20A421 

-1.88 

85 

81 

0.52 

0.98 

0.11 

0.56 

-0.42 

0.00 

0.23 

1.04 
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Appendix  D:  Item  Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

20A422 

0.00 

69 

69 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

20A423 

-1.70 

66 

63 

0.62 

1.08 

0.32 

5.57 

2.56 

0.01 

0.09 

0.85 

20A424 

-1.93 

66 

63 

0.61 

0.92 

0.00 

0.70 

0.02 

0.00 

0.27 

1.05 

20A425 

0.43 

66 

53 

0.35 

0.76 

-1.29 

0.55 

-1.41 

0.00 

0.58 

1.30 

20A426 

1.94 

70 

28 

0.27 

0.90 

-0.84 

0.95 

-0.24 

0.00 

0.52 

1.19 

20A427 

1.02 

138 

94 

0.21 

1.02 

0.25 

1.03 

0.23 

0.01 

0.46 

0.97 

20A428 

0.09 

89 

71 

0.29 

0.93 

-0.39 

0.76 

-0.75 

0.00 

0.42 

1.11 

20A429 

-0.39 

80 

66 

0.31 

0.91 

-0.42 

0.69 

-0.86 

0.00 

0.41 

1.14 

20A43 

-2.67 

75 

73 

0.73 

0.88 

0.03 

0.25 

-0.71 

0.00 

0.29 

1.10 

2OA430 

-0.34 

80 

71 

0.39 

0.74 

-1.02 

0.42 

-1.21 

0.00 

0.52 

1.23 

20A431 

-0.36 

69 

54 

0.32 

0.88 

-0.76 

0.65 

-1.04 

0.00 

0.46 

1.23 

20A432 

0.55 

84 

58 

0.26 

1.28 

2.33 

1.42 

1.65 

0.00 

0.17 

0.39 

20A433 

0.53 

69 

48 

0.29 

0.89 

-0.89 

0.90 

-0.37 

0.00 

0.47 

1.20 

20A434 

0.73 

97 

70 

0.25 

0.78 

-1.80 

0.77 

-1.12 

0.00 

0.60 

1.31 

20A435 

0.48 

72 

49 

0.27 

0.95 

-0.45 

0.89 

-0.61 

0.00 

0.41 

1.14 

20A436 

0.88 

85 

54 

0.25 

1.05 

0.54 

1.14 

0.90 

0.00 

0.36 

0.84 

20A437 

-0.32 

69 

60 

0.38 

1.16 

0.70 

1.58 

1.15 

0.01 

0.15 

0.80 

20A438 

0.44 

66 

51 

0.33 

1.14 

0.83 

1.16 

0.51 

0.01 

0.36 

0.81 

20A439 

0.84 

66 

45 

0.31 

1.20 

1.24 

1.15 

0.63 

0.00 

0.39 

0.72 

20A44 

-1.15 

66 

62 

0.54 

0.84 

-0.29 

0.52 

-0.41 

0.00 

0.37 

1.12 

2OA440 

-0.76 

70 

60 

0.37 

0.92 

-0.28 

0.75 

-0.45 

0.00 

0.40 

1.09 

20A45 

-2.52 

89 

87 

0.73 

0.93 

0.11 

0.33 

-0.58 

0.00 

0.24 

1.07 

20A46 

-2.21 

79 

76 

0.60 

0.95 

0.07 

0.60 

-0.29 

0.00 

0.24 

1.05 

20A47 

-1.67 

75 

70 

0.48 

0.92 

-0.10 

0.56 

-0.53 

0.00 

0.31 

1.08 

20A48 

-1.35 

80 

76 

0.54 

0.72 

-0.60 

0.22 

-1.00 

0.00 

0.45 

1.19 

20A49 

-1.09 

69 

60 

0.38 

0.94 

-0.17 

1.41 

0.86 

0.00 

0.31 

1.01 
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Appendix  E:  Distractor  Statistics 


Appendix  E:  Distractor  Statistics  for  Full  CCSS  Item  Bank 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21501 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21501 

A 

1 

39 

89 

1.89 

0.16 

0.71 

0.61 

21501 

B 

0 

3 

7 

-0.64 

0.33 

0.20 

-0.50 

21501 

C 

0 

1 

2 

-1.09 

0.00 

0.11 

-0.34 

21501 

D 

0 

1 

2 

0.76 

0.00 

0.72 

-0.11 

21502 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21502 

A 

1 

37 

82 

1.87 

0.21 

0.64 

0.61 

21502 

B 

0 

5 

11 

-0.44 

0.60 

0.64 

-0.43 

21502 

C 

0 

2 

4 

-0.79 

0.23 

0.22 

-0.32 

21502 

D 

0 

1 

2 

-0.74 

0.00 

0.22 

-0.21 

21503 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21503 

A 

1 

41 

89 

1.85 

0.25 

0.90 

0.41 

21503 

B 

0 

2 

4 

-0.76 

0.03 

0.21 

-0.31 

21503 

C 

0 

2 

4 

0.10 

0.37 

0.53 

-0.20 

21503 

D 

0 

1 

2 

0.05 

0.00 

0.47 

-0.15 

21504 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21504 

A 

1 

38 

86 

1.71 

0.19 

0.66 

0.62 

21504 

B 

0 

3 

7 

-1.60 

0.91 

0.21 

-0.53 

21504 

C 

0 

2 

5 

0.49 

0.42 

0.90 

-0.12 

21504 

D 

0 

1 

2 

-2.04 

0.00 

0.07 

-0.34 

21505 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21505 

A 

1 

40 

89 

1.68 

0.21 

1.22 

0.36 

21505 

B 

0 

1 

2 

-0.16 

0.00 

0.31 

-0.16 

21505 

C 

0 

3 

7 

1.40 

0.62 

2.19 

-0.01 

21505 

D 

0 

1 

2 

-4.52 

0.00 

0.00 

-0.58 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21506 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21506 

A 

1 

40 

87 

1.81 

0.24 

0.79 

0.46 

21506 

B 

0 

4 

9 

0.27 

0.58 

1.23 

-0.23 

21506 

C 

0 

1 

2 

-2.06 

0.00 

0.07 

-0.32 

21506 

D 

0 

1 

2 

-1.73 

0.00 

0.10 

-0.29 

21507 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21507 

A 

1 

39 

89 

1.58 

0.23 

1.02 

0.32 

21507 

B 

0 

1 

2 

1.54 

0.00 

2.29 

0.01 

21507 

C 

0 

1 

2 

1.18 

0.00 

1.59 

-0.03 

21507 

D 

0 

3 

7 

-0.71 

0.38 

0.27 

-0.39 

21508 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

21508 

A 

1 

38 

83 

1.70 

0.24 

0.79 

0.54 

21508 

B 

0 

5 

11 

-0.17 

0.57 

0.87 

-0.30 

21508 

C 

0 

2 

4 

-1.51 

0.58 

0.16 

-0.35 

21508 

D 

0 

1 

2 

-2.01 

0.00 

0.08 

-0.29 

21509 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21509 

A 

1 

38 

84 

1.92 

0.22 

0.86 

0.43 

21509 

B 

0 

3 

7 

0.59 

0.81 

1.26 

-0.20 

21509 

C 

0 

3 

7 

0.28 

0.29 

0.52 

-0.26 

21509 

D 

0 

1 

2 

-1.07 

0.00 

0.13 

-0.29 

21510 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

21510 

A 

1 

35 

78 

1.42 

0.24 

0.90 

0.51 

21510 

B 

0 

2 

4 

-1.20 

0.79 

0.27 

-0.31 

21510 

C 

0 

6 

13 

-0.34 

0.31 

0.61 

-0.34 

21510 

D 

0 

2 

4 

-0.20 

1.37 

1.16 

-0.17 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21511 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21511 

A 

1 

36 

80 

1.54 

0.21 

0.91 

0.37 

21511 

B 

0 

1 

2 

0.63 

0.00 

0.85 

-0.07 

21511 

C 

0 

7 

16 

0.51 

0.58 

1.67 

-0.25 

21511 

D 

0 

1 

2 

-1.57 

0.00 

0.09 

-0.32 

21512 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.02 

21512 

A 

1 

34 

79 

1.64 

0.18 

0.74 

0.47 

21512 

B 

0 

4 

9 

1.48 

0.72 

3.69 

0.04 

21512 

C 

0 

3 

7 

-0.35 

0.83 

0.62 

-0.31 

21512 

D 

0 

2 

5 

-2.64 

0.01 

0.03 

-0.59 

21513 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

21513 

A 

1 

38 

84 

1.49 

0.25 

0.86 

0.47 

21513 

B 

0 

3 

7 

-0.67 

0.85 

0.75 

-0.28 

21513 

C 

0 

2 

4 

0.79 

0.62 

1.84 

-0.04 

21513 

D 

0 

2 

4 

-2.41 

1.60 

0.16 

-0.44 

21514 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21514 

A 

1 

37 

82 

2.00 

0.24 

0.99 

0.38 

21514 

B 

0 

5 

11 

0.27 

0.35 

0.62 

-0.35 

21514 

C 

0 

2 

4 

0.89 

0.84 

1.22 

-0.12 

21514 

D 

0 

1 

2 

1.15 

0.00 

1.16 

-0.06 

21515 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21515 

A 

1 

40 

87 

1.92 

0.25 

1.03 

0.33 

21515 

B 

0 

2 

4 

0.41 

1.06 

1.09 

-0.17 

21515 

C 

0 

2 

4 

1.54 

1.05 

3.34 

-0.02 

21515 

D 

0 

2 

4 

-1.03 

0.96 

0.24 

-0.35 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21516 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21516 

A 

1 

41 

91 

1.79 

0.21 

0.84 

0.41 

21516 

B 

0 

3 

7 

0.10 

0.14 

0.45 

-0.28 

21516 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21516 

D 

0 

1 

2 

-1.53 

0.00 

0.09 

-0.33 

21517 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21517 

A 

1 

27 

60 

1.76 

0.22 

0.86 

0.45 

21517 

B 

0 

3 

7 

0.68 

1.20 

1.51 

-0.11 

21517 

C 

0 

11 

24 

0.47 

0.40 

1.23 

-0.32 

21517 

D 

0 

4 

9 

0.42 

0.68 

1.03 

-0.19 

21518 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.03 

21518 

A 

1 

28 

65 

1.72 

0.27 

0.96 

0.53 

21518 

B 

0 

6 

14 

0.00 

0.50 

0.98 

-0.30 

21518 

C 

0 

7 

16 

0.35 

0.35 

0.92 

-0.22 

21518 

D 

0 

2 

5 

-1.07 

1.57 

0.39 

-0.31 

21519 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21519 

A 

1 

38 

86 

1.99 

0.25 

0.90 

0.53 

21519 

B 

0 

1 

2 

-1.50 

0.00 

0.11 

-0.27 

21519 

C 

0 

4 

9 

0.03 

0.28 

0.58 

-0.29 

21519 

D 

0 

1 

2 

-2.81 

0.00 

0.03 

-0.39 

21520 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21520 

A 

1 

36 

80 

1.75 

0.21 

0.83 

0.49 

21520 

B 

0 

6 

13 

0.04 

0.41 

0.67 

-0.39 

21520 

C 

0 

1 

2 

1.03 

0.00 

1.13 

-0.04 

21520 

D 

0 

2 

4 

-0.35 

1.66 

0.78 

-0.27 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21521 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21521 

A 

1 

39 

85 

1.66 

0.21 

0.77 

0.49 

21521 

B 

0 

2 

4 

-0.04 

0.83 

0.68 

-0.20 

21521 

C 

0 

3 

7 

-0.06 

1.27 

2.05 

-0.25 

21521 

D 

0 

2 

4 

-1.08 

0.80 

0.24 

-0.35 

21522 

* 

-1 

3812 

95 

1.49 

0.02 

0.00 

-0.07 

21522 

A 

1 

163 

91 

2.13 

0.11 

0.97 

0.34 

21522 

B 

0 

9 

5 

0.67 

0.25 

0.71 

-0.21 

21522 

C 

0 

7 

4 

0.49 

0.51 

1.41 

-0.21 

21522 

D 

0 

1 

1 

-1.42 

0.00 

0.07 

-0.18 

21523 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21523 

A 

1 

40 

89 

1.84 

0.21 

0.91 

0.43 

21523 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21523 

C 

0 

3 

7 

-0.19 

0.13 

0.32 

-0.36 

21523 

D 

0 

2 

4 

0.22 

1.02 

0.74 

-0.22 

21524 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21524 

A 

1 

38 

84 

2.17 

0.27 

0.94 

0.53 

21524 

B 

0 

3 

7 

0.00 

0.76 

0.91 

-0.23 

21524 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21524 

D 

0 

4 

9 

-1.38 

1.38 

0.43 

-0.48 

21525 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21525 

A 

1 

37 

82 

1.77 

0.23 

0.76 

0.52 

21525 

B 

0 

3 

7 

-0.03 

0.46 

0.53 

-0.26 

21525 

C 

0 

3 

7 

-0.17 

0.13 

0.39 

-0.28 

21525 

D 

0 

2 

4 

-0.74 

0.15 

0.22 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21526 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.05 

21526 

A 

1 

30 

68 

1.50 

0.17 

0.58 

0.71 

21526 

B 

0 

5 

11 

-0.19 

0.53 

0.79 

-0.26 

21526 

C 

0 

2 

5 

0.73 

0.01 

1.16 

-0.01 

21526 

D 

0 

7 

16 

-1.38 

0.35 

0.19 

-0.68 

21527 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

21527 

A 

1 

33 

72 

1.40 

0.22 

1.03 

0.28 

21527 

B 

0 

9 

20 

1.14 

0.37 

2.26 

-0.01 

21527 

C 

0 

2 

4 

-1.06 

0.10 

0.16 

-0.37 

21527 

D 

0 

2 

4 

-0.15 

0.44 

0.43 

-0.22 

21528 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21528 

A 

1 

36 

80 

1.82 

0.23 

0.96 

0.37 

21528 

B 

0 

6 

13 

1.04 

0.58 

2.14 

-0.13 

21528 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21528 

D 

0 

3 

7 

-0.80 

0.63 

0.24 

-0.42 

21529 

* 

-1 

3795 

95 

1.50 

0.02 

0.00 

-0.04 

21529 

A 

1 

180 

91 

1.92 

0.10 

0.95 

0.35 

21529 

B 

0 

7 

4 

0.16 

0.40 

0.63 

-0.21 

21529 

C 

0 

8 

4 

0.04 

0.29 

0.52 

-0.24 

21529 

D 

0 

2 

1 

0.02 

1.08 

0.62 

-0.12 

21530 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21530 

A 

1 

36 

80 

1.64 

0.26 

0.90 

0.46 

21530 

B 

0 

3 

7 

0.19 

0.47 

0.88 

-0.17 

21530 

C 

0 

3 

7 

-0.22 

1.32 

2.14 

-0.23 

21530 

D 

0 

3 

7 

-0.84 

0.66 

0.36 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21531 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21531 

A 

1 

36 

78 

1.78 

0.22 

0.83 

0.53 

21531 

B 

0 

2 

4 

-1.02 

0.40 

0.19 

-0.32 

21531 

C 

0 

5 

11 

0.57 

0.79 

2.90 

-0.17 

21531 

D 

0 

3 

7 

-1.18 

0.62 

0.22 

-0.42 

21532 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21532 

A 

1 

37 

82 

1.87 

0.23 

0.76 

0.58 

21532 

B 

0 

2 

4 

-0.86 

0.30 

0.21 

-0.32 

21532 

C 

0 

5 

11 

-0.40 

0.39 

0.46 

-0.42 

21532 

D 

0 

1 

2 

0.04 

0.00 

0.50 

-0.14 

21533 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21533 

A 

1 

43 

96 

1.93 

0.24 

0.99 

0.23 

21533 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21533 

C 

0 

1 

2 

0.51 

0.00 

0.63 

-0.13 

21533 

D 

0 

1 

2 

-0.20 

0.00 

0.31 

-0.20 

21534 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21534 

A 

1 

40 

87 

1.85 

0.18 

0.75 

0.61 

21534 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21534 

C 

0 

3 

7 

-0.33 

0.42 

0.35 

-0.35 

21534 

D 

0 

3 

7 

-0.99 

0.63 

0.20 

-0.48 

21535 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21535 

A 

1 

34 

76 

1.98 

0.23 

0.96 

0.45 

21535 

B 

0 

3 

7 

1.15 

0.55 

1.32 

-0.08 

21535 

C 

0 

4 

9 

0.54 

0.91 

1.75 

-0.22 

21535 

D 

0 

4 

9 

-0.37 

0.70 

0.41 

-0.40 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21536 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21536 

A 

1 

40 

89 

1.50 

0.16 

0.86 

0.47 

21536 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21536 

C 

0 

4 

9 

0.00 

0.29 

0.49 

-0.37 

21536 

D 

0 

1 

2 

-0.96 

0.00 

0.16 

-0.31 

21537 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21537 

A 

1 

36 

78 

1.68 

0.20 

0.90 

0.37 

21537 

B 

0 

6 

13 

1.55 

0.41 

2.64 

0.04 

21537 

C 

0 

2 

4 

-1.17 

0.90 

0.17 

-0.39 

21537 

D 

0 

2 

4 

-1.37 

0.78 

0.13 

-0.42 

21538 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21538 

A 

1 

35 

78 

1.75 

0.27 

1.00 

0.34 

21538 

B 

0 

1 

2 

0.08 

0.00 

0.46 

-0.13 

21538 

C 

0 

7 

16 

0.26 

0.51 

1.46 

-0.33 

21538 

D 

0 

2 

4 

1.38 

0.81 

2.30 

-0.01 

21539 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21539 

A 

1 

35 

80 

2.15 

0.25 

0.52 

0.69 

21539 

B 

0 

1 

2 

-1.29 

0.00 

0.15 

-0.20 

21539 

C 

0 

5 

11 

-0.50 

0.47 

0.47 

-0.34 

21539 

D 

0 

3 

7 

-2.76 

1.38 

0.10 

-0.55 

21540 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21540 

A 

1 

41 

91 

1.83 

0.22 

1.10 

0.41 

21540 

B 

0 

1 

2 

-0.35 

0.00 

0.33 

-0.20 

21540 

C 

0 

1 

2 

-2.11 

0.00 

0.06 

-0.37 

21540 

D 

0 

2 

4 

0.56 

0.20 

0.84 

-0.15 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21541 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21541 

A 

1 

35 

78 

2.03 

0.24 

0.76 

0.66 

21541 

B 

0 

4 

9 

-0.69 

0.23 

0.26 

-0.40 

21541 

C 

0 

4 

9 

-0.49 

0.50 

0.39 

-0.36 

21541 

D 

0 

2 

4 

-0.78 

0.05 

0.21 

-0.29 

21542 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21542 

A 

1 

41 

91 

1.97 

0.26 

1.20 

0.24 

21542 

B 

0 

2 

4 

-0.98 

0.39 

0.18 

-0.36 

21542 

C 

0 

2 

4 

2.04 

1.37 

6.92 

0.03 

21542 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21543 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21543 

A 

1 

32 

71 

2.01 

0.24 

0.69 

0.58 

21543 

B 

0 

4 

9 

0.01 

0.68 

0.72 

-0.25 

21543 

C 

0 

5 

11 

0.15 

0.71 

1.15 

-0.26 

21543 

D 

0 

4 

9 

-0.72 

0.95 

0.40 

-0.39 

21544 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21544 

A 

1 

37 

82 

1.65 

0.22 

1.05 

0.29 

21544 

B 

0 

3 

7 

-0.35 

0.34 

0.28 

-0.37 

21544 

C 

0 

4 

9 

1.53 

0.37 

1.97 

0.01 

21544 

D 

0 

1 

2 

0.08 

0.00 

0.39 

-0.16 

21545 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21545 

A 

1 

40 

89 

1.85 

0.24 

0.96 

0.40 

21545 

B 

0 

5 

11 

-0.12 

0.41 

0.60 

-0.40 

21545 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21545 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21546 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21546 

A 

1 

40 

89 

1.63 

0.20 

1.08 

0.17 

21546 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21546 

C 

0 

2 

4 

0.84 

1.26 

1.61 

-0.12 

21546 

D 

0 

3 

7 

1.01 

0.78 

1.81 

-0.12 

21547 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21547 

A 

1 

41 

91 

1.67 

0.26 

1.24 

0.36 

21547 

B 

0 

2 

4 

0.53 

1.55 

2.31 

-0.11 

21547 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21547 

D 

0 

2 

4 

-1.76 

1.78 

0.56 

-0.39 

21548 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21548 

A 

1 

39 

87 

1.59 

0.19 

0.75 

0.54 

21548 

B 

0 

2 

4 

-0.19 

0.37 

0.46 

-0.22 

21548 

C 

0 

1 

2 

-0.80 

0.00 

0.23 

-0.21 

21548 

D 

0 

3 

7 

-1.06 

1.45 

0.67 

-0.43 

21549 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21549 

A 

1 

38 

84 

1.82 

0.24 

0.85 

0.41 

21549 

B 

0 

3 

7 

-0.27 

0.77 

0.52 

-0.31 

21549 

C 

0 

3 

7 

0.78 

0.62 

1.36 

-0.13 

21549 

D 

0 

1 

2 

-1.07 

0.00 

0.15 

-0.25 

21550 

* 

-1 

3951 

99 

1.51 

0.02 

0.00 

0.00 

21550 

A 

1 

35 

85 

1.97 

0.25 

0.70 

0.55 

21550 

B 

0 

2 

5 

-0.66 

1.44 

0.55 

-0.30 

21550 

C 

0 

4 

10 

-0.67 

0.47 

0.31 

-0.43 

21550 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21551 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21551 

A 

1 

35 

80 

2.12 

0.22 

0.73 

0.59 

21551 

B 

0 

5 

11 

0.03 

0.47 

0.58 

-0.39 

21551 

C 

0 

2 

5 

-0.19 

0.04 

0.30 

-0.27 

21551 

D 

0 

2 

5 

-0.21 

0.48 

0.33 

-0.28 

21552 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

21552 

A 

1 

40 

87 

1.39 

0.22 

1.11 

0.19 

21552 

B 

0 

2 

4 

0.75 

0.39 

1.05 

-0.09 

21552 

C 

0 

2 

4 

0.03 

0.20 

0.48 

-0.20 

21552 

D 

0 

2 

4 

1.11 

0.10 

1.41 

-0.03 

21553 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21553 

A 

1 

30 

67 

1.54 

0.23 

0.98 

0.37 

21553 

B 

0 

6 

13 

0.84 

0.52 

1.65 

-0.12 

21553 

C 

0 

6 

13 

0.09 

0.47 

0.74 

-0.35 

21553 

D 

0 

3 

7 

0.91 

0.50 

1.27 

-0.06 

21554 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21554 

A 

1 

41 

91 

1.96 

0.25 

0.91 

0.32 

21554 

B 

0 

1 

2 

-0.34 

0.00 

0.26 

-0.20 

21554 

C 

0 

2 

4 

0.19 

0.92 

0.63 

-0.22 

21554 

D 

0 

1 

2 

0.53 

0.00 

0.61 

-0.12 

21555 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

21555 

A 

1 

39 

87 

2.29 

0.21 

0.58 

0.63 

21555 

B 

0 

2 

4 

0.21 

0.70 

0.58 

-0.22 

21555 

C 

0 

4 

9 

-1.22 

0.23 

0.12 

-0.59 

21555 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21556 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21556 

A 

1 

39 

89 

1.55 

0.24 

1.05 

0.19 

21556 

B 

0 

1 

2 

1.35 

0.00 

1.73 

-0.01 

21556 

C 

0 

2 

5 

0.72 

0.35 

0.98 

-0.11 

21556 

D 

0 

2 

5 

0.29 

1.15 

1.04 

-0.18 

21557 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21557 

A 

1 

41 

91 

1.57 

0.22 

0.97 

0.31 

21557 

B 

0 

3 

7 

0.22 

0.80 

1.15 

-0.22 

21557 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21557 

D 

0 

1 

2 

-0.87 

0.00 

0.21 

-0.24 

21558 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

21558 

A 

1 

38 

84 

2.11 

0.22 

0.87 

0.39 

21558 

B 

0 

2 

4 

0.24 

0.33 

0.38 

-0.25 

21558 

C 

0 

4 

9 

0.68 

0.93 

1.57 

-0.26 

21558 

D 

0 

1 

2 

1.03 

0.00 

0.79 

-0.09 

21559 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.01 

21559 

A 

1 

31 

72 

2.16 

0.28 

1.07 

0.48 

21559 

B 

0 

9 

21 

0.61 

0.47 

1.54 

-0.32 

21559 

C 

0 

1 

2 

0.42 

0.00 

0.52 

-0.12 

21559 

D 

0 

2 

5 

-0.76 

0.17 

0.16 

-0.32 

21560 

* 

-1 

3786 

95 

1.51 

0.02 

0.00 

-0.01 

21560 

A 

1 

186 

90 

1.70 

0.09 

0.96 

0.35 

21560 

B 

0 

15 

7 

0.30 

0.18 

0.62 

-0.27 

21560 

C 

0 

3 

1 

0.09 

0.57 

0.53 

-0.14 

21560 

D 

0 

2 

1 

-0.65 

2.16 

0.85 

-0.17 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21561 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

21561 

A 

1 

37 

80 

1.41 

0.21 

1.04 

0.39 

21561 

B 

0 

4 

9 

0.37 

0.28 

0.82 

-0.18 

21561 

C 

0 

5 

11 

-0.11 

0.50 

0.83 

-0.33 

21561 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21562 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21562 

A 

1 

34 

76 

2.35 

0.26 

0.63 

0.63 

21562 

B 

0 

6 

13 

0.35 

0.43 

0.88 

-0.30 

21562 

C 

0 

2 

4 

-1.10 

0.33 

0.13 

-0.34 

21562 

D 

0 

3 

7 

-0.84 

0.63 

0.22 

-0.38 

21563 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.02 

21563 

A 

1 

33 

75 

2.21 

0.21 

0.79 

0.57 

21563 

B 

0 

5 

11 

0.52 

0.40 

0.60 

-0.32 

21563 

C 

0 

3 

7 

1.02 

0.77 

1.19 

-0.14 

21563 

D 

0 

3 

7 

-0.54 

0.40 

0.18 

-0.44 

21564 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21564 

A 

1 

38 

86 

1.89 

0.21 

0.91 

0.39 

21564 

B 

0 

1 

2 

0.21 

0.00 

0.41 

-0.17 

21564 

C 

0 

4 

9 

0.20 

0.50 

0.63 

-0.35 

21564 

D 

0 

1 

2 

1.19 

0.00 

1.08 

-0.06 

21565 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

21565 

A 

1 

39 

85 

1.63 

0.21 

0.70 

0.60 

21565 

B 

0 

4 

9 

-1.09 

0.39 

0.23 

-0.47 

21565 

C 

0 

2 

4 

-0.45 

0.90 

0.53 

-0.24 

21565 

D 

0 

1 

2 

-1.25 

0.00 

0.17 

-0.24 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21566 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21566 

A 

1 

34 

76 

1.84 

0.26 

0.85 

0.50 

21566 

B 

0 

6 

13 

-0.21 

0.29 

0.46 

-0.40 

21566 

C 

0 

3 

7 

-0.21 

0.20 

0.38 

-0.28 

21566 

D 

0 

2 

4 

1.05 

0.83 

1.74 

-0.05 

21567 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21567 

A 

1 

37 

84 

2.23 

0.23 

0.50 

0.69 

21567 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21567 

C 

0 

2 

5 

-0.41 

0.91 

0.47 

-0.23 

21567 

D 

0 

5 

11 

-1.82 

0.73 

0.21 

-0.64 

21568 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21568 

A 

1 

39 

89 

1.61 

0.24 

0.92 

0.39 

21568 

B 

0 

3 

7 

-0.29 

0.71 

0.64 

-0.30 

21568 

C 

0 

2 

5 

-0.26 

0.12 

0.40 

-0.24 

21568 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21569 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21569 

A 

1 

37 

84 

1.80 

0.22 

0.97 

0.43 

21569 

B 

0 

4 

9 

0.21 

0.22 

0.48 

-0.31 

21569 

C 

0 

2 

5 

-0.16 

0.75 

0.40 

-0.28 

21569 

D 

0 

1 

2 

1.00 

0.00 

0.98 

-0.06 

21570 

* 

-1 

3808 

95 

1.50 

0.02 

0.00 

-0.06 

21570 

A 

1 

172 

93 

2.02 

0.10 

0.90 

0.32 

21570 

B 

0 

6 

3 

0.74 

0.62 

1.69 

-0.15 

21570 

C 

0 

4 

2 

-0.05 

0.83 

0.86 

-0.21 

21570 

D 

0 

2 

1 

-0.78 

0.23 

0.15 

-0.20 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21571 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21571 

A 

1 

32 

73 

2.04 

0.27 

0.85 

0.52 

21571 

B 

0 

4 

9 

-0.22 

0.35 

0.39 

-0.30 

21571 

C 

0 

5 

11 

0.57 

0.65 

1.40 

-0.18 

21571 

D 

0 

3 

7 

-0.84 

1.68 

0.83 

-0.35 

21572 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

21572 

A 

1 

35 

80 

1.73 

0.20 

0.73 

0.60 

21572 

B 

0 

7 

16 

-0.02 

0.24 

0.50 

-0.40 

21572 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21572 

D 

0 

2 

5 

-1.70 

0.95 

0.12 

-0.46 

21573 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21573 

A 

1 

39 

85 

1.72 

0.22 

1.02 

0.37 

21573 

B 

0 

2 

4 

-0.03 

0.44 

0.43 

-0.23 

21573 

C 

0 

4 

9 

0.71 

0.52 

1.15 

-0.17 

21573 

D 

0 

1 

2 

-1.04 

0.00 

0.14 

-0.27 

21574 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21574 

A 

1 

38 

86 

1.71 

0.26 

1.00 

0.38 

21574 

B 

0 

4 

9 

-0.32 

0.35 

0.43 

-0.35 

21574 

C 

0 

2 

5 

0.39 

0.66 

0.90 

-0.15 

21574 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21575 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21575 

A 

1 

33 

75 

2.31 

0.21 

0.65 

0.69 

21575 

B 

0 

1 

2 

-0.35 

0.00 

0.23 

-0.19 

21575 

C 

0 

7 

16 

0.37 

0.32 

0.64 

-0.35 

21575 

D 

0 

3 

7 

-1.75 

0.50 

0.07 

-0.57 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21576 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.03 

21576 

A 

1 

35 

81 

1.68 

0.22 

0.75 

0.65 

21576 

B 

0 

4 

9 

-0.46 

0.46 

0.50 

-0.31 

21576 

C 

0 

1 

2 

-0.64 

0.00 

0.31 

-0.17 

21576 

D 

0 

3 

7 

-2.15 

1.01 

0.17 

-0.54 

21577 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21577 

A 

1 

39 

87 

1.71 

0.25 

0.79 

0.49 

21577 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21577 

C 

0 

4 

9 

-0.59 

0.22 

0.35 

-0.37 

21577 

D 

0 

2 

4 

-0.95 

0.55 

0.26 

-0.30 

21578 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21578 

A 

1 

42 

93 

1.45 

0.19 

0.91 

0.33 

21578 

B 

0 

2 

4 

0.40 

0.81 

0.97 

-0.16 

21578 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21578 

D 

0 

1 

2 

-1.43 

0.00 

0.12 

-0.33 

21579 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

21579 

A 

1 

35 

78 

1.39 

0.23 

0.97 

0.44 

21579 

B 

0 

5 

11 

-0.61 

0.40 

0.40 

-0.39 

21579 

C 

0 

4 

9 

0.91 

0.31 

1.64 

-0.03 

21579 

D 

0 

1 

2 

-2.57 

0.00 

0.04 

-0.36 

21580 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21580 

A 

1 

40 

87 

1.81 

0.27 

1.04 

0.33 

21580 

B 

0 

4 

9 

0.07 

0.62 

0.88 

-0.27 

21580 

C 

0 

2 

4 

0.25 

0.81 

0.90 

-0.16 

21580 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21581 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.04 

21581 

A 

1 

40 

87 

1.18 

0.20 

0.91 

0.40 

21581 

B 

0 

3 

7 

-0.79 

0.41 

0.35 

-0.35 

21581 

C 

0 

3 

7 

0.01 

0.53 

0.88 

-0.19 

21581 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21582 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

21582 

A 

1 

33 

75 

1.62 

0.22 

0.89 

0.46 

21582 

B 

0 

6 

14 

0.25 

0.35 

0.74 

-0.32 

21582 

C 

0 

3 

7 

-0.09 

0.64 

0.58 

-0.29 

21582 

D 

0 

2 

5 

0.73 

0.03 

0.85 

-0.09 

21583 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21583 

A 

1 

32 

71 

1.89 

0.23 

0.96 

0.47 

21583 

B 

0 

5 

11 

0.07 

0.56 

0.73 

-0.34 

21583 

C 

0 

5 

11 

0.95 

0.44 

1.27 

-0.13 

21583 

D 

0 

3 

7 

0.03 

1.12 

0.96 

-0.27 

21584 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21584 

A 

1 

42 

93 

1.62 

0.19 

0.91 

0.35 

21584 

B 

0 

2 

4 

-0.32 

0.90 

0.43 

-0.30 

21584 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21584 

D 

0 

1 

2 

0.05 

0.00 

0.43 

-0.17 

21585 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21585 

A 

1 

35 

80 

1.61 

0.25 

1.14 

0.31 

21585 

B 

0 

5 

11 

0.37 

0.38 

0.79 

-0.26 

21585 

C 

0 

4 

9 

0.74 

0.58 

1.26 

-0.15 

21585 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21586 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.02 

21586 

A 

1 

35 

81 

1.66 

0.24 

0.66 

0.60 

21586 

B 

0 

3 

7 

-0.29 

0.51 

0.57 

-0.25 

21586 

C 

0 

2 

5 

-0.54 

0.10 

0.35 

-0.24 

21586 

D 

0 

3 

7 

-1.52 

0.12 

0.13 

-0.46 

21587 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

21587 

A 

1 

30 

68 

1.70 

0.27 

0.98 

0.50 

21587 

B 

0 

6 

14 

0.49 

0.37 

1.04 

-0.16 

21587 

C 

0 

5 

11 

0.26 

0.56 

0.97 

-0.19 

21587 

D 

0 

3 

7 

-1.65 

0.23 

0.10 

-0.47 

21588 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21588 

A 

1 

37 

84 

2.04 

0.26 

0.93 

0.45 

21588 

B 

0 

3 

7 

0.26 

0.50 

0.67 

-0.24 

21588 

C 

0 

1 

2 

-1.09 

0.00 

0.14 

-0.26 

21588 

D 

0 

3 

7 

0.18 

0.50 

0.64 

-0.26 

21589 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

21589 

A 

1 

42 

95 

1.43 

0.19 

0.76 

0.46 

21589 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21589 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21589 

D 

0 

2 

5 

-1.61 

0.80 

0.17 

-0.46 

21590 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

0.00 

21590 

A 

1 

37 

84 

1.79 

0.23 

0.95 

0.35 

21590 

B 

0 

4 

9 

1.14 

0.70 

2.12 

-0.09 

21590 

C 

0 

1 

2 

0.82 

0.00 

0.93 

-0.08 

21590 

D 

0 

2 

5 

-1.44 

0.21 

0.10 

-0.44 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21591 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.02 

21591 

A 

1 

35 

81 

2.04 

0.26 

1.14 

0.39 

21591 

B 

0 

2 

5 

0.63 

1.12 

1.17 

-0.16 

21591 

C 

0 

5 

12 

0.46 

0.60 

1.26 

-0.29 

21591 

D 

0 

1 

2 

-0.07 

0.00 

0.34 

-0.18 

21592 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21592 

A 

1 

39 

85 

1.80 

0.20 

0.82 

0.48 

21592 

B 

0 

1 

2 

0.04 

0.00 

0.43 

-0.16 

21592 

C 

0 

4 

9 

0.42 

0.72 

1.51 

-0.24 

21592 

D 

0 

2 

4 

-1.12 

0.20 

0.14 

-0.40 

21593 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21593 

A 

1 

43 

93 

1.63 

0.18 

0.85 

0.38 

21593 

B 

0 

2 

4 

0.21 

0.78 

0.65 

-0.22 

21593 

C 

0 

1 

2 

-1.22 

0.00 

0.12 

-0.33 

21593 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21594 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21594 

A 

1 

39 

85 

1.70 

0.21 

0.86 

0.42 

21594 

B 

0 

1 

2 

1.10 

0.00 

1.30 

-0.04 

21594 

C 

0 

3 

7 

-0.37 

0.51 

0.39 

-0.34 

21594 

D 

0 

3 

7 

0.07 

0.98 

1.14 

-0.25 

21595 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21595 

A 

1 

35 

78 

1.95 

0.27 

0.85 

0.48 

21595 

B 

0 

6 

13 

0.33 

0.51 

1.43 

-0.27 

21595 

C 

0 

1 

2 

-1.34 

0.00 

0.13 

-0.25 

21595 

D 

0 

3 

7 

-0.31 

0.55 

0.47 

-0.28 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21597 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21597 

A 

1 

38 

86 

1.82 

0.18 

0.86 

0.40 

21597 

B 

0 

2 

5 

1.04 

0.76 

1.15 

-0.11 

21597 

C 

0 

2 

5 

0.23 

1.96 

1.43 

-0.25 

21597 

D 

0 

2 

5 

-0.04 

0.66 

0.37 

-0.30 

21598 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.03 

21598 

A 

1 

41 

93 

2.05 

0.24 

1.08 

0.15 

21598 

B 

0 

1 

2 

1.42 

0.00 

1.25 

-0.06 

21598 

C 

0 

2 

5 

1.05 

0.53 

0.99 

-0.14 

21598 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21599 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21599 

A 

1 

37 

80 

2.19 

0.23 

0.71 

0.61 

21599 

B 

0 

6 

13 

-0.61 

0.53 

0.38 

-0.53 

21599 

C 

0 

2 

4 

0.55 

0.41 

0.72 

-0.14 

21599 

D 

0 

1 

2 

-0.95 

0.00 

0.15 

-0.23 

21600 

* 

-1 

3848 

96 

1.51 

0.02 

0.00 

-0.04 

21600 

A 

1 

114 

79 

2.16 

0.11 

0.83 

0.53 

21600 

B 

0 

10 

7 

0.35 

0.46 

0.80 

-0.28 

21600 

C 

0 

15 

10 

0.60 

0.26 

0.80 

-0.29 

21600 

D 

0 

5 

3 

-0.42 

0.59 

0.31 

-0.30 

21601 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21601 

A 

1 

33 

75 

1.82 

0.26 

1.17 

0.44 

21601 

B 

0 

6 

14 

0.55 

0.44 

1.31 

-0.23 

21601 

C 

0 

2 

5 

0.10 

0.72 

0.57 

-0.19 

21601 

D 

0 

3 

7 

-0.22 

0.76 

0.49 

-0.29 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21602 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21602 

A 

1 

31 

69 

2.21 

0.21 

0.73 

0.61 

21602 

B 

0 

3 

7 

-0.36 

0.34 

0.22 

-0.38 

21602 

C 

0 

9 

20 

0.46 

0.37 

0.79 

-0.41 

21602 

D 

0 

2 

4 

0.83 

0.53 

0.74 

-0.12 

21603 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21603 

A 

1 

33 

75 

2.16 

0.22 

0.67 

0.63 

21603 

B 

0 

7 

16 

0.07 

0.52 

0.78 

-0.42 

21603 

C 

0 

4 

9 

-0.41 

0.56 

0.32 

-0.41 

21603 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21604 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

21604 

A 

1 

38 

83 

1.93 

0.19 

1.11 

0.27 

21604 

B 

0 

3 

7 

1.66 

0.64 

1.92 

-0.03 

21604 

C 

0 

5 

11 

0.72 

0.58 

1.06 

-0.30 

21604 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21605 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

21605 

A 

1 

34 

76 

2.19 

0.20 

0.91 

0.44 

21605 

B 

0 

4 

9 

1.46 

0.29 

1.01 

-0.12 

21605 

C 

0 

7 

16 

0.75 

0.23 

0.50 

-0.43 

21605 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21606 

* 

-1 

1453 

36 

1.65 

0.03 

0.00 

0.07 

21606 

A 

1 

1972 

78 

1.84 

0.03 

0.93 

0.48 

21606 

B 

0 

285 

11 

0.51 

0.06 

1.28 

-0.22 

21606 

C 

0 

199 

8 

-0.11 

0.07 

0.56 

-0.30 

21606 

D 

0 

83 

3 

-1.05 

0.14 

0.27 

-0.30 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21607 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

21607 

A 

1 

41 

91 

2.05 

0.23 

1.01 

0.30 

21607 

B 

0 

1 

2 

2.04 

0.00 

2.48 

0.01 

21607 

C 

0 

3 

7 

-0.01 

0.27 

0.34 

-0.35 

21607 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21608 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.03 

21608 

A 

1 

38 

86 

2.17 

0.19 

0.72 

0.57 

21608 

B 

0 

1 

2 

0.14 

0.00 

0.33 

-0.19 

21608 

C 

0 

4 

9 

0.37 

0.40 

0.53 

-0.35 

21608 

D 

0 

1 

2 

-2.08 

0.00 

0.04 

-0.44 

21609 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21609 

A 

1 

39 

87 

1.75 

0.19 

0.66 

0.63 

21609 

B 

0 

2 

4 

-0.74 

1.32 

0.50 

-0.31 

21609 

C 

0 

3 

7 

-1.04 

0.48 

0.23 

-0.44 

21609 

D 

0 

1 

2 

-1.43 

0.00 

0.13 

-0.29 

21610 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21610 

A 

1 

40 

89 

1.74 

0.20 

0.92 

0.43 

21610 

B 

0 

1 

2 

-1.33 

0.00 

0.10 

-0.27 

21610 

C 

0 

2 

4 

0.23 

0.23 

0.47 

-0.17 

21610 

D 

0 

2 

4 

-0.72 

3.80 

7.89 

-0.30 

21611 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21611 

A 

1 

37 

82 

1.73 

0.23 

1.06 

0.41 

21611 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21611 

C 

0 

7 

16 

0.27 

0.38 

0.72 

-0.35 

21611 

D 

0 

1 

2 

-0.52 

0.00 

0.24 

-0.20 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21612 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21612 

A 

1 

32 

71 

1.75 

0.20 

0.90 

0.54 

21612 

B 

0 

7 

16 

0.76 

0.50 

2.37 

-0.15 

21612 

C 

0 

3 

7 

-0.47 

0.40 

0.29 

-0.32 

21612 

D 

0 

3 

7 

-1.18 

0.77 

0.19 

-0.45 

21613 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

21613 

A 

1 

36 

82 

1.69 

0.26 

0.70 

0.53 

21613 

B 

0 

4 

9 

-0.45 

0.51 

0.55 

-0.32 

21613 

C 

0 

3 

7 

-0.59 

0.68 

0.52 

-0.30 

21613 

D 

0 

1 

2 

-1.74 

0.00 

0.10 

-0.27 

21614 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21614 

A 

1 

39 

87 

1.97 

0.26 

0.57 

0.58 

21614 

B 

0 

1 

2 

-3.11 

0.00 

0.03 

-0.34 

21614 

C 

0 

2 

4 

0.95 

0.35 

1.99 

-0.06 

21614 

D 

0 

3 

7 

-2.67 

0.87 

0.09 

-0.54 

21615 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

21615 

A 

1 

30 

68 

1.74 

0.22 

0.74 

0.58 

21615 

B 

0 

6 

14 

0.73 

0.20 

0.96 

-0.14 

21615 

C 

0 

7 

16 

-0.19 

0.18 

0.38 

-0.45 

21615 

D 

0 

1 

2 

-2.00 

0.00 

0.06 

-0.36 

21616 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21616 

A 

1 

35 

76 

2.10 

0.23 

0.61 

0.64 

21616 

B 

0 

5 

11 

0.05 

0.32 

0.49 

-0.32 

21616 

C 

0 

5 

11 

-0.58 

0.34 

0.28 

-0.46 

21616 

D 

0 

1 

2 

-0.73 

0.00 

0.19 

-0.21 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21617 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21617 

A 

1 

38 

83 

1.84 

0.21 

0.86 

0.56 

21617 

B 

0 

3 

7 

-0.29 

0.36 

0.34 

-0.33 

21617 

C 

0 

4 

9 

-0.17 

0.25 

0.36 

-0.37 

21617 

D 

0 

1 

2 

-0.15 

0.00 

0.33 

-0.17 

21618 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21618 

A 

1 

38 

84 

1.69 

0.18 

0.64 

0.63 

21618 

B 

0 

5 

11 

-0.71 

0.22 

0.25 

-0.54 

21618 

C 

0 

2 

4 

-0.49 

0.53 

0.32 

-0.29 

21618 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21619 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21619 

A 

1 

36 

80 

2.09 

0.20 

0.60 

0.66 

21619 

B 

0 

3 

7 

-0.02 

0.99 

0.67 

-0.27 

21619 

C 

0 

1 

2 

-0.46 

0.00 

0.23 

-0.19 

21619 

D 

0 

5 

11 

-0.89 

0.54 

0.26 

-0.54 

21620 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21620 

A 

1 

37 

80 

2.01 

0.27 

0.98 

0.45 

21620 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21620 

C 

0 

7 

15 

0.18 

0.34 

0.69 

-0.38 

21620 

D 

0 

2 

4 

0.10 

0.20 

0.46 

-0.20 

21621 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21621 

A 

1 

38 

84 

1.96 

0.26 

0.73 

0.51 

21621 

B 

0 

3 

7 

0.08 

1.14 

1.88 

-0.23 

21621 

C 

0 

2 

4 

-0.54 

0.18 

0.30 

-0.26 

21621 

D 

0 

2 

4 

-1.21 

0.25 

0.16 

-0.35 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21622 

* 

-1 

3743 

94 

1.51 

0.02 

0.00 

-0.01 

21622 

A 

1 

219 

88 

1.73 

0.08 

0.96 

0.37 

21622 

B 

0 

13 

5 

0.04 

0.22 

0.47 

-0.30 

21622 

C 

0 

16 

6 

0.71 

0.15 

0.80 

-0.19 

21622 

D 

0 

1 

0 

-1.01 

0.00 

0.12 

-0.14 

21623 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21623 

A 

1 

39 

87 

1.63 

0.19 

1.06 

0.25 

21623 

B 

0 

2 

4 

0.35 

0.88 

0.70 

-0.21 

21623 

C 

0 

4 

9 

0.99 

0.64 

1.58 

-0.14 

21623 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21624 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

21624 

A 

1 

37 

80 

1.62 

0.22 

0.84 

0.47 

21624 

B 

0 

8 

17 

0.10 

0.45 

1.01 

-0.34 

21624 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21624 

D 

0 

1 

2 

-2.81 

0.00 

0.03 

-0.39 

21625 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21625 

A 

1 

35 

78 

1.98 

0.24 

0.95 

0.62 

21625 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21625 

C 

0 

6 

13 

-0.63 

0.61 

0.43 

-0.48 

21625 

D 

0 

4 

9 

-0.39 

0.32 

0.34 

-0.34 

21626 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

21626 

A 

1 

38 

83 

2.12 

0.26 

1.16 

0.44 

21626 

B 

0 

4 

9 

0.19 

0.51 

0.72 

-0.30 

21626 

C 

0 

3 

7 

0.49 

0.29 

0.69 

-0.21 

21626 

D 

0 

1 

2 

-0.57 

0.00 

0.22 

-0.21 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21627 

* 

-1 

3938 

99 

1.51 

0.02 

0.00 

-0.01 

21627 

A 

1 

45 

83 

2.00 

0.19 

0.80 

0.56 

21627 

B 

0 

1 

2 

-0.92 

0.00 

0.15 

-0.23 

21627 

C 

0 

6 

11 

0.21 

0.38 

0.64 

-0.33 

21627 

D 

0 

2 

4 

-1.44 

0.80 

0.12 

-0.40 

21628 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21628 

A 

1 

38 

86 

1.83 

0.19 

0.89 

0.45 

21628 

B 

0 

2 

5 

1.03 

0.11 

0.97 

-0.10 

21628 

C 

0 

3 

7 

-0.71 

0.27 

0.18 

-0.49 

21628 

D 

0 

1 

2 

0.94 

0.00 

0.88 

-0.08 

21629 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21629 

A 

1 

37 

80 

1.62 

0.22 

1.01 

0.40 

21629 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21629 

C 

0 

7 

15 

0.11 

0.30 

0.62 

-0.39 

21629 

D 

0 

2 

4 

0.79 

1.21 

1.70 

-0.09 

21630 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21630 

A 

1 

32 

73 

1.94 

0.21 

0.84 

0.61 

21630 

B 

0 

7 

16 

0.02 

0.38 

0.54 

-0.45 

21630 

C 

0 

5 

11 

0.08 

0.41 

0.52 

-0.35 

21630 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21631 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21631 

A 

1 

36 

80 

2.07 

0.23 

0.70 

0.60 

21631 

B 

0 

1 

2 

-0.53 

0.00 

0.24 

-0.20 

21631 

C 

0 

7 

16 

-0.15 

0.43 

0.55 

-0.46 

21631 

D 

0 

1 

2 

-1.64 

0.00 

0.08 

-0.30 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21632 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

21632 

A 

1 

33 

73 

1.65 

0.23 

1.00 

0.57 

21632 

B 

0 

7 

16 

-0.20 

0.37 

0.53 

-0.40 

21632 

C 

0 

3 

7 

-0.38 

0.41 

0.39 

-0.28 

21632 

D 

0 

2 

4 

0.00 

0.54 

0.55 

-0.17 

21633 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21633 

A 

1 

36 

82 

1.74 

0.25 

0.93 

0.47 

21633 

B 

0 

3 

7 

-0.06 

0.26 

0.47 

-0.26 

21633 

C 

0 

4 

9 

0.16 

0.38 

0.65 

-0.26 

21633 

D 

0 

1 

2 

-1.57 

0.00 

0.10 

-0.29 

21634 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21634 

A 

1 

38 

86 

1.92 

0.23 

0.86 

0.43 

21634 

B 

0 

2 

5 

0.34 

0.68 

0.64 

-0.20 

21634 

C 

0 

3 

7 

0.11 

0.19 

0.43 

-0.29 

21634 

D 

0 

1 

2 

-0.62 

0.00 

0.20 

-0.24 

21635 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21635 

A 

1 

34 

76 

1.93 

0.24 

1.07 

0.48 

21635 

B 

0 

5 

11 

0.22 

0.53 

0.69 

-0.29 

21635 

C 

0 

5 

11 

0.19 

0.85 

1.01 

-0.30 

21635 

D 

0 

1 

2 

0.17 

0.00 

0.43 

-0.13 

21636 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21636 

A 

1 

39 

87 

2.11 

0.25 

0.80 

0.46 

21636 

B 

0 

2 

4 

0.14 

0.81 

0.63 

-0.22 

21636 

C 

0 

2 

4 

0.56 

1.11 

1.20 

-0.16 

21636 

D 

0 

2 

4 

-1.19 

0.88 

0.18 

-0.39 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21637 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.04 

21637 

A 

1 

42 

91 

2.29 

0.22 

1.06 

0.40 

21637 

B 

0 

3 

7 

-0.53 

0.07 

0.18 

-0.47 

21637 

C 

0 

1 

2 

2.34 

0.00 

3.11 

0.02 

21637 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21638 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21638 

A 

1 

36 

80 

2.01 

0.26 

1.33 

0.29 

21638 

B 

0 

2 

4 

1.14 

0.11 

0.97 

-0.09 

21638 

C 

0 

5 

11 

1.04 

0.43 

1.17 

-0.17 

21638 

D 

0 

2 

4 

0.33 

1.63 

1.13 

-0.21 

21639 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21639 

A 

1 

41 

89 

1.63 

0.22 

1.06 

0.36 

21639 

B 

0 

2 

4 

0.01 

1.35 

1.07 

-0.21 

21639 

C 

0 

1 

2 

-0.85 

0.00 

0.22 

-0.23 

21639 

D 

0 

2 

4 

0.29 

0.39 

0.74 

-0.17 

21640 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21640 

A 

1 

39 

87 

1.96 

0.25 

0.70 

0.55 

21640 

B 

0 

2 

4 

-0.41 

0.86 

0.50 

-0.24 

21640 

C 

0 

2 

4 

-0.65 

0.86 

0.40 

-0.27 

21640 

D 

0 

2 

4 

-1.73 

0.11 

0.10 

-0.40 

21641 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21641 

A 

1 

40 

89 

1.90 

0.21 

0.69 

0.54 

21641 

B 

0 

1 

2 

-3.11 

0.00 

0.02 

-0.44 

21641 

C 

0 

3 

7 

0.31 

0.61 

0.92 

-0.21 

21641 

D 

0 

1 

2 

-2.01 

0.00 

0.06 

-0.34 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21642 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21642 

A 

1 

37 

82 

1.58 

0.22 

0.85 

0.41 

21642 

B 

0 

2 

4 

-0.21 

1.57 

0.97 

-0.23 

21642 

C 

0 

2 

4 

0.73 

0.74 

1.27 

-0.09 

21642 

D 

0 

4 

9 

-0.22 

0.83 

0.99 

-0.33 

21643 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21643 

A 

1 

40 

89 

1.64 

0.22 

1.09 

0.31 

21643 

B 

0 

2 

4 

-0.69 

0.30 

0.25 

-0.32 

21643 

C 

0 

3 

7 

0.80 

0.98 

2.56 

-0.13 

21643 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21644 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

21644 

A 

1 

39 

85 

1.32 

0.26 

1.18 

0.27 

21644 

B 

0 

3 

7 

0.33 

0.33 

0.98 

-0.14 

21644 

C 

0 

2 

4 

0.34 

0.47 

0.99 

-0.11 

21644 

D 

0 

2 

4 

-0.27 

0.80 

0.65 

-0.20 

21645 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21645 

A 

1 

41 

91 

1.72 

0.20 

0.97 

0.25 

21645 

B 

0 

1 

2 

1.53 

0.00 

1.69 

-0.01 

21645 

C 

0 

1 

2 

-0.86 

0.00 

0.15 

-0.29 

21645 

D 

0 

2 

4 

0.80 

0.72 

1.04 

-0.14 

21646 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21646 

A 

1 

44 

98 

1.20 

0.19 

1.08 

-0.02 

21646 

B 

0 

1 

2 

1.37 

0.00 

2.33 

0.02 

21646 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21646 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21647 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21647 

A 

1 

43 

96 

1.40 

0.18 

0.92 

0.27 

21647 

B 

0 

1 

2 

-1.34 

0.00 

0.13 

-0.33 

21647 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21647 

D 

0 

1 

2 

0.96 

0.00 

1.25 

-0.05 

21648 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

21648 

A 

1 

38 

86 

1.52 

0.24 

1.17 

0.40 

21648 

B 

0 

4 

9 

0.30 

0.78 

1.77 

-0.18 

21648 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21648 

D 

0 

2 

5 

-1.83 

1.93 

0.36 

-0.41 

21649 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21649 

A 

1 

41 

91 

1.35 

0.16 

0.88 

0.46 

21649 

B 

0 

3 

7 

-0.36 

0.21 

0.35 

-0.37 

21649 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21649 

D 

0 

1 

2 

-0.72 

0.00 

0.23 

-0.26 

21650 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

21650 

A 

1 

40 

89 

1.03 

0.20 

1.08 

0.25 

21650 

B 

0 

3 

7 

-0.49 

0.22 

0.42 

-0.30 

21650 

C 

0 

1 

2 

1.58 

0.00 

3.20 

0.08 

21650 

D 

0 

1 

2 

0.17 

0.00 

0.79 

-0.09 

21651 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21651 

A 

1 

41 

91 

1.65 

0.26 

0.93 

0.36 

21651 

B 

0 

2 

4 

0.29 

1.61 

2.54 

-0.14 

21651 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21651 

D 

0 

2 

4 

-1.52 

0.63 

0.19 

-0.36 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21652 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21652 

A 

1 

44 

98 

1.59 

0.19 

1.08 

0.01 

21652 

B 

0 

1 

2 

1.55 

0.00 

1.97 

-0.01 

21652 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21652 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21653 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.04 

21653 

A 

1 

30 

65 

1.63 

0.22 

0.74 

0.61 

21653 

B 

0 

8 

17 

0.01 

0.43 

0.87 

-0.25 

21653 

C 

0 

3 

7 

0.44 

0.26 

0.80 

-0.08 

21653 

D 

0 

5 

11 

-1.70 

0.74 

0.20 

-0.56 

21654 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.04 

21654 

A 

1 

39 

89 

1.14 

0.23 

0.97 

0.31 

21654 

B 

0 

4 

9 

-0.09 

0.43 

0.82 

-0.24 

21654 

C 

0 

1 

2 

-0.75 

0.00 

0.33 

-0.19 

21654 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21655 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21655 

A 

1 

35 

78 

1.84 

0.21 

0.68 

0.64 

21655 

B 

0 

6 

13 

-0.27 

0.26 

0.43 

-0.37 

21655 

C 

0 

2 

4 

0.19 

0.31 

0.59 

-0.14 

21655 

D 

0 

2 

4 

-2.77 

1.53 

0.07 

-0.53 

21656 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21656 

A 

1 

40 

89 

1.39 

0.19 

0.90 

0.40 

21656 

B 

0 

2 

4 

0.50 

0.32 

0.88 

-0.12 

21656 

C 

0 

3 

7 

-0.70 

0.41 

0.29 

-0.40 

21656 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21657 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

21657 

A 

1 

35 

78 

2.37 

0.25 

1.98 

0.56 

21657 

B 

0 

7 

16 

0.18 

0.17 

0.37 

-0.43 

21657 

C 

0 

1 

2 

2.06 

0.00 

2.20 

0.02 

21657 

D 

0 

2 

4 

-1.22 

1.42 

0.18 

-0.39 

21658 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21658 

A 

1 

37 

82 

1.79 

0.20 

1.37 

0.19 

21658 

B 

0 

7 

16 

1.32 

0.33 

1.36 

-0.14 

21658 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21658 

D 

0 

1 

2 

0.46 

0.00 

0.43 

-0.16 

21659 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21659 

A 

1 

43 

96 

1.47 

0.28 

1.02 

0.22 

21659 

B 

0 

1 

2 

-1.73 

0.00 

0.16 

-0.26 

21659 

C 

0 

1 

2 

0.82 

0.00 

2.02 

-0.05 

21659 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21660 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21660 

A 

-1 

45 

100 

1.56 

0.22 

0.00 

0.00 

21660 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

21660 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

21660 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

21661 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.03 

21661 

A 

1 

37 

86 

2.33 

0.24 

0.74 

0.58 

21661 

B 

0 

2 

5 

0.52 

0.35 

0.64 

-0.18 

21661 

C 

0 

1 

2 

-0.13 

0.00 

0.32 

-0.19 

21661 

D 

0 

3 

7 

-1.35 

0.71 

0.16 

-0.52 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21662 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21662 

A 

1 

37 

82 

1.83 

0.28 

1.10 

0.36 

21662 

B 

0 

4 

9 

0.08 

0.27 

0.60 

-0.27 

21662 

C 

0 

2 

4 

-0.82 

0.32 

0.23 

-0.30 

21662 

D 

0 

2 

4 

1.49 

0.73 

2.77 

-0.01 

21663 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.05 

21663 

A 

1 

34 

76 

1.28 

0.26 

0.99 

0.46 

21663 

B 

0 

3 

7 

0.05 

0.15 

0.74 

-0.15 

21663 

C 

0 

3 

7 

-0.24 

0.49 

0.70 

-0.20 

21663 

D 

0 

5 

11 

-0.59 

0.23 

0.43 

-0.35 

21664 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21664 

A 

1 

35 

78 

2.15 

0.25 

1.00 

0.46 

21664 

B 

0 

3 

7 

0.58 

0.35 

0.63 

-0.21 

21664 

C 

0 

2 

4 

1.22 

0.69 

1.32 

-0.08 

21664 

D 

0 

5 

11 

0.13 

0.33 

0.46 

-0.39 

21665 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21665 

A 

1 

35 

78 

1.69 

0.26 

1.00 

0.47 

21665 

B 

0 

4 

9 

0.28 

0.33 

0.75 

-0.20 

21665 

C 

0 

3 

7 

-0.76 

0.64 

0.34 

-0.35 

21665 

D 

0 

3 

7 

0.12 

0.25 

0.60 

-0.20 

21666 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

21666 

A 

1 

28 

65 

1.73 

0.21 

0.96 

0.37 

21666 

B 

0 

4 

9 

0.57 

0.27 

0.60 

-0.22 

21666 

C 

0 

4 

9 

1.27 

1.08 

3.28 

-0.03 

21666 

D 

0 

7 

16 

0.64 

0.37 

0.84 

-0.28 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21667 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21667 

A 

1 

43 

96 

1.84 

0.25 

1.05 

0.29 

21667 

B 

0 

2 

4 

-0.49 

0.46 

0.38 

-0.29 

21667 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21667 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21668 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21668 

A 

1 

32 

71 

1.68 

0.23 

1.24 

0.33 

21668 

B 

0 

5 

11 

0.75 

0.43 

0.97 

-0.18 

21668 

C 

0 

2 

4 

1.78 

0.66 

2.46 

0.06 

21668 

D 

0 

6 

13 

0.38 

0.47 

0.78 

-0.31 

21669 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21669 

A 

1 

36 

80 

1.93 

0.24 

0.88 

0.48 

21669 

B 

0 

4 

9 

-0.53 

0.63 

0.37 

-0.43 

21669 

C 

0 

3 

7 

0.77 

0.55 

1.10 

-0.14 

21669 

D 

0 

2 

4 

0.31 

0.66 

0.65 

-0.18 

21670 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21670 

A 

1 

30 

65 

1.88 

0.25 

0.90 

0.54 

21670 

B 

0 

6 

13 

0.50 

0.38 

0.92 

-0.22 

21670 

C 

0 

4 

9 

0.38 

0.42 

0.71 

-0.20 

21670 

D 

0 

6 

13 

-0.04 

0.32 

0.44 

-0.37 

21671 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21671 

A 

1 

37 

82 

1.67 

0.18 

0.78 

0.56 

21671 

B 

0 

3 

7 

-0.03 

0.53 

0.49 

-0.29 

21671 

C 

0 

2 

4 

0.14 

0.55 

0.54 

-0.21 

21671 

D 

0 

3 

7 

-0.49 

0.58 

0.32 

-0.39 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21672 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

21672 

A 

1 

40 

87 

1.94 

0.30 

1.30 

0.24 

21672 

B 

0 

6 

13 

0.61 

0.37 

1.18 

-0.24 

21672 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21672 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21673 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21673 

A 

1 

39 

85 

1.88 

0.17 

0.78 

0.51 

21673 

B 

0 

4 

9 

0.78 

0.53 

1.11 

-0.21 

21673 

C 

0 

3 

7 

-0.68 

0.61 

0.24 

-0.50 

21673 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21674 

* 

-1 

3945 

99 

1.51 

0.02 

0.00 

-0.02 

21674 

A 

1 

42 

89 

1.90 

0.21 

1.14 

0.31 

21674 

B 

0 

2 

4 

0.66 

0.09 

0.65 

-0.17 

21674 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21674 

D 

0 

3 

6 

0.44 

0.46 

0.64 

-0.25 

21675 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21675 

A 

1 

41 

93 

1.51 

0.21 

0.79 

0.47 

21675 

B 

0 

1 

2 

-1.46 

0.00 

0.14 

-0.29 

21675 

C 

0 

1 

2 

-1.29 

0.00 

0.16 

-0.28 

21675 

D 

0 

1 

2 

-0.89 

0.00 

0.24 

-0.23 

21676 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21676 

A 

1 

41 

91 

1.66 

0.23 

0.69 

0.53 

21676 

B 

0 

2 

4 

-1.41 

0.16 

0.18 

-0.35 

21676 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21676 

D 

0 

2 

4 

-1.76 

2.54 

0.81 

-0.39 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21677 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21677 

A 

1 

41 

91 

1.65 

0.22 

0.77 

0.44 

21677 

B 

0 

3 

7 

-0.60 

0.82 

0.50 

-0.36 

21677 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21677 

D 

0 

1 

2 

-0.96 

0.00 

0.20 

-0.24 

21678 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

21678 

A 

1 

40 

89 

2.05 

0.23 

1.10 

0.31 

21678 

B 

0 

2 

4 

0.67 

0.75 

0.85 

-0.18 

21678 

C 

0 

1 

2 

-0.02 

0.00 

0.33 

-0.20 

21678 

D 

0 

2 

4 

0.88 

0.97 

1.22 

-0.15 

21679 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21679 

A 

1 

40 

89 

1.67 

0.23 

1.00 

0.31 

21679 

B 

0 

3 

7 

1.14 

0.30 

1.66 

-0.07 

21679 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21679 

D 

0 

2 

4 

-1.26 

0.27 

0.14 

-0.40 

21680 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21680 

A 

1 

28 

62 

2.05 

0.27 

1.13 

0.45 

21680 

B 

0 

13 

29 

0.80 

0.30 

1.26 

-0.33 

21680 

C 

0 

2 

4 

1.37 

0.35 

1.22 

-0.03 

21680 

D 

0 

2 

4 

-0.40 

0.47 

0.22 

-0.29 

21681 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21681 

A 

1 

42 

95 

1.45 

0.23 

1.00 

0.33 

21681 

B 

0 

2 

5 

-0.96 

0.77 

0.36 

-0.33 

21681 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21681 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21682 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.00 

21682 

A 

1 

41 

95 

1.59 

0.20 

0.81 

0.39 

21682 

B 

0 

1 

2 

-0.08 

0.00 

0.43 

-0.18 

21682 

C 

0 

1 

2 

-1.70 

0.00 

0.08 

-0.37 

21682 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21683 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21683 

A 

1 

43 

96 

1.43 

0.20 

1.10 

0.20 

21683 

B 

0 

1 

2 

-0.45 

0.00 

0.34 

-0.21 

21683 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21683 

D 

0 

1 

2 

0.78 

0.00 

1.15 

-0.07 

21684 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21684 

A 

1 

41 

91 

1.55 

0.18 

0.67 

0.57 

21684 

B 

0 

1 

2 

-1.02 

0.00 

0.20 

-0.24 

21684 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21684 

D 

0 

3 

7 

-1.43 

1.39 

0.46 

-0.51 

21685 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21685 

A 

1 

41 

91 

1.85 

0.25 

0.85 

0.46 

21685 

B 

0 

1 

2 

-0.69 

0.00 

0.29 

-0.20 

21685 

C 

0 

1 

2 

-0.75 

0.00 

0.27 

-0.21 

21685 

D 

0 

2 

4 

-1.11 

0.14 

0.19 

-0.34 

21686 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21686 

A 

1 

30 

68 

1.97 

0.20 

0.80 

0.60 

21686 

B 

0 

11 

25 

0.40 

0.23 

0.55 

-0.51 

21686 

C 

0 

1 

2 

1.55 

0.00 

1.40 

0.01 

21686 

D 

0 

2 

5 

-0.13 

0.52 

0.30 

-0.29 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21687 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21687 

A 

1 

39 

87 

1.51 

0.22 

0.92 

0.49 

21687 

B 

0 

2 

4 

-0.83 

0.42 

0.28 

-0.29 

21687 

C 

0 

3 

7 

-0.81 

0.87 

0.52 

-0.36 

21687 

D 

0 

1 

2 

0.18 

0.00 

0.71 

-0.10 

21688 

* 

-1 

3951 

99 

1.52 

0.02 

0.00 

0.01 

21688 

A 

1 

31 

76 

1.86 

0.30 

1.04 

0.48 

21688 

B 

0 

2 

5 

0.30 

0.87 

0.93 

-0.15 

21688 

C 

0 

3 

7 

0.23 

0.36 

0.69 

-0.20 

21688 

D 

0 

5 

12 

-0.26 

0.39 

0.47 

-0.37 

21689 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

21689 

A 

1 

37 

86 

1.76 

0.23 

0.77 

0.55 

21689 

B 

0 

1 

2 

0.07 

0.00 

0.55 

-0.13 

21689 

C 

0 

4 

9 

-0.94 

0.43 

0.27 

-0.48 

21689 

D 

0 

1 

2 

-0.55 

0.00 

0.30 

-0.19 

21690 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

21690 

A 

1 

37 

82 

1.24 

0.18 

0.85 

0.53 

21690 

B 

0 

3 

7 

-0.64 

0.44 

0.38 

-0.34 

21690 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21690 

D 

0 

5 

11 

-0.36 

0.35 

0.51 

-0.37 

21691 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

21691 

A 

1 

38 

86 

1.35 

0.21 

0.90 

0.44 

21691 

B 

0 

1 

2 

-0.56 

0.00 

0.32 

-0.19 

21691 

C 

0 

2 

5 

0.31 

0.42 

0.83 

-0.13 

21691 

D 

0 

3 

7 

-0.74 

0.20 

0.28 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21692 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.04 

21692 

A 

1 

38 

86 

1.32 

0.22 

0.90 

0.49 

21692 

B 

0 

2 

5 

-1.06 

0.36 

0.26 

-0.31 

21692 

C 

0 

1 

2 

-1.42 

0.00 

0.17 

-0.25 

21692 

D 

0 

3 

7 

-0.44 

0.29 

0.48 

-0.27 

21693 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21693 

A 

1 

41 

91 

1.68 

0.21 

1.02 

0.46 

21693 

B 

0 

1 

2 

-1.59 

0.00 

0.10 

-0.32 

21693 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21693 

D 

0 

3 

7 

-0.31 

0.18 

0.37 

-0.33 

21694 

* 

-1 

3945 

99 

1.52 

0.02 

0.00 

0.02 

21694 

A 

1 

41 

87 

1.53 

0.16 

0.75 

0.59 

21694 

B 

0 

2 

4 

-1.04 

0.08 

0.16 

-0.40 

21694 

C 

0 

1 

2 

-0.27 

0.00 

0.34 

-0.19 

21694 

D 

0 

3 

6 

-0.38 

0.20 

0.32 

-0.36 

21695 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

21695 

A 

1 

37 

84 

1.55 

0.21 

1.00 

0.52 

21695 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21695 

C 

0 

3 

7 

-0.83 

0.46 

0.30 

-0.38 

21695 

D 

0 

4 

9 

-0.31 

0.69 

0.86 

-0.33 

21696 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

21696 

A 

1 

40 

87 

1.31 

0.22 

1.19 

0.22 

21696 

B 

0 

4 

9 

0.78 

0.59 

2.02 

-0.09 

21696 

C 

0 

2 

4 

-0.29 

0.06 

0.42 

-0.23 

21696 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21697 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21697 

A 

1 

41 

91 

1.40 

0.19 

0.81 

0.49 

21697 

B 

0 

1 

2 

-1.00 

0.00 

0.20 

-0.25 

21697 

C 

0 

1 

2 

-1.31 

0.00 

0.15 

-0.29 

21697 

D 

0 

2 

4 

-0.55 

0.01 

0.32 

-0.29 

21698 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21698 

A 

1 

38 

84 

1.77 

0.32 

1.30 

0.45 

21698 

B 

0 

3 

7 

0.50 

0.55 

2.04 

-0.11 

21698 

C 

0 

2 

4 

-1.17 

0.24 

0.29 

-0.25 

21698 

D 

0 

2 

4 

-2.79 

1.51 

0.13 

-0.42 

21699 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21699 

A 

1 

40 

89 

1.84 

0.19 

1.08 

0.27 

21699 

B 

0 

4 

9 

0.90 

0.25 

0.73 

-0.23 

21699 

C 

0 

1 

2 

0.74 

0.00 

0.57 

-0.13 

21699 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21700 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

21700 

A 

1 

35 

76 

2.16 

0.23 

0.89 

0.45 

21700 

B 

0 

7 

15 

1.02 

0.49 

1.27 

-0.22 

21700 

C 

0 

4 

9 

-0.18 

0.42 

0.32 

-0.41 

21700 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21701 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

21701 

A 

1 

31 

67 

1.87 

0.30 

1.00 

0.53 

21701 

B 

0 

11 

24 

-0.08 

0.26 

0.60 

-0.46 

21701 

C 

0 

3 

7 

0.36 

0.43 

0.84 

-0.15 

21701 

D 

0 

1 

2 

0.07 

0.00 

0.52 

-0.11 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21702 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

0.00 

21702 

A 

1 

39 

85 

1.85 

0.22 

1.07 

0.45 

21702 

B 

0 

3 

7 

0.09 

0.47 

0.52 

-0.28 

21702 

C 

0 

1 

2 

0.74 

0.00 

0.82 

-0.09 

21702 

D 

0 

3 

7 

-0.17 

0.25 

0.35 

-0.32 

21703 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21703 

A 

1 

34 

77 

1.65 

0.26 

1.66 

0.36 

21703 

B 

0 

9 

20 

0.65 

0.22 

0.94 

-0.24 

21703 

C 

0 

1 

2 

-2.07 

0.00 

0.05 

-0.35 

21703 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21704 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21704 

A 

1 

40 

89 

1.73 

0.19 

0.91 

0.39 

21704 

B 

0 

3 

7 

0.19 

0.36 

0.45 

-0.31 

21704 

C 

0 

1 

2 

0.35 

0.00 

0.46 

-0.15 

21704 

D 

0 

1 

2 

0.26 

0.00 

0.42 

-0.16 

21705 

* 

-1 

3782 

95 

1.51 

0.02 

0.00 

-0.02 

21705 

A 

1 

174 

83 

1.86 

0.09 

0.96 

0.41 

21705 

B 

0 

15 

7 

0.52 

0.24 

0.88 

-0.24 

21705 

C 

0 

20 

10 

0.48 

0.23 

0.72 

-0.29 

21705 

D 

0 

1 

0 

-0.72 

0.00 

0.15 

-0.13 

21706 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21706 

A 

1 

33 

73 

2.02 

0.22 

0.68 

0.64 

21706 

B 

0 

3 

7 

-0.65 

0.37 

0.25 

-0.32 

21706 

C 

0 

7 

16 

0.20 

0.39 

0.72 

-0.30 

21706 

D 

0 

2 

4 

-2.08 

1.94 

0.18 

-0.45 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21707 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21707 

A 

1 

38 

84 

1.67 

0.18 

0.79 

0.49 

21707 

B 

0 

4 

9 

-0.92 

0.28 

0.18 

-0.56 

21707 

C 

0 

3 

7 

1.03 

0.48 

1.46 

-0.08 

21707 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21708 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21708 

A 

1 

40 

87 

1.92 

0.25 

0.87 

0.43 

21708 

B 

0 

2 

4 

-0.06 

0.96 

0.65 

-0.22 

21708 

C 

0 

3 

7 

0.40 

0.84 

1.14 

-0.20 

21708 

D 

0 

1 

2 

-2.40 

0.00 

0.04 

-0.36 

21709 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21709 

A 

1 

40 

89 

1.78 

0.21 

0.98 

0.29 

21709 

B 

0 

2 

4 

1.74 

0.04 

2.10 

0.02 

21709 

C 

0 

2 

4 

-0.29 

1.02 

0.43 

-0.31 

21709 

D 

0 

1 

2 

-0.21 

0.00 

0.30 

-0.21 

21710 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21710 

A 

1 

38 

84 

1.62 

0.25 

1.02 

0.42 

21710 

B 

0 

3 

7 

0.15 

0.24 

0.63 

-0.21 

21710 

C 

0 

3 

7 

-0.05 

0.06 

0.49 

-0.24 

21710 

D 

0 

1 

2 

-1.57 

0.00 

0.11 

-0.28 

21711 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

21711 

A 

1 

36 

82 

1.55 

0.23 

0.83 

0.50 

21711 

B 

0 

1 

2 

-0.27 

0.00 

0.41 

-0.16 

21711 

C 

0 

6 

14 

-0.46 

0.28 

0.43 

-0.46 

21711 

D 

0 

1 

2 

0.49 

0.00 

0.87 

-0.08 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21712 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

21712 

A 

1 

36 

80 

1.49 

0.25 

1.77 

0.48 

21712 

B 

0 

4 

9 

-0.26 

0.29 

0.49 

-0.28 

21712 

C 

0 

5 

11 

-0.49 

0.39 

0.45 

-0.37 

21712 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21713 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21713 

A 

1 

32 

71 

1.75 

0.22 

0.78 

0.54 

21713 

B 

0 

4 

9 

1.12 

0.48 

1.81 

-0.02 

21713 

C 

0 

4 

9 

0.04 

0.41 

0.54 

-0.23 

21713 

D 

0 

5 

11 

-1.28 

0.90 

0.32 

-0.56 

21714 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21714 

A 

1 

36 

82 

2.07 

0.28 

0.94 

0.49 

21714 

B 

0 

2 

5 

-0.44 

0.39 

0.34 

-0.25 

21714 

C 

0 

4 

9 

0.20 

0.78 

1.24 

-0.25 

21714 

D 

0 

2 

5 

-0.89 

0.61 

0.24 

-0.30 

21715 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

21715 

A 

1 

33 

72 

1.65 

0.26 

0.96 

0.41 

21715 

B 

0 

9 

20 

0.43 

0.47 

2.04 

-0.25 

21715 

C 

0 

3 

7 

-0.94 

0.25 

0.20 

-0.37 

21715 

D 

0 

1 

2 

1.61 

0.00 

2.40 

0.03 

21716 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21716 

A 

1 

40 

89 

1.50 

0.25 

0.99 

0.34 

21716 

B 

0 

1 

2 

0.33 

0.00 

0.84 

-0.09 

21716 

C 

0 

2 

4 

0.39 

0.29 

0.94 

-0.12 

21716 

D 

0 

2 

4 

-1.17 

0.84 

0.26 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21717 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21717 

A 

1 

34 

76 

1.69 

0.24 

1.14 

0.40 

21717 

B 

0 

6 

13 

0.53 

0.42 

1.22 

-0.23 

21717 

C 

0 

4 

9 

0.32 

0.41 

0.75 

-0.23 

21717 

D 

0 

1 

2 

-0.21 

0.00 

0.33 

-0.17 

21718 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

21718 

A 

1 

31 

72 

1.77 

0.26 

0.87 

0.48 

21718 

B 

0 

9 

21 

0.45 

0.34 

1.05 

-0.29 

21718 

C 

0 

2 

5 

-0.44 

0.42 

0.30 

-0.25 

21718 

D 

0 

1 

2 

-1.74 

0.00 

0.07 

-0.31 

21719 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21719 

A 

1 

39 

87 

1.61 

0.26 

0.93 

0.25 

21719 

B 

0 

2 

4 

2.04 

0.00 

3.59 

0.08 

21719 

C 

0 

3 

7 

0.13 

0.16 

0.55 

-0.22 

21719 

D 

0 

1 

2 

-1.88 

0.00 

0.07 

-0.31 

21720 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21720 

A 

1 

32 

71 

1.74 

0.21 

0.87 

0.54 

21720 

B 

0 

6 

13 

0.24 

0.37 

0.82 

-0.27 

21720 

C 

0 

4 

9 

0.85 

0.74 

2.23 

-0.09 

21720 

D 

0 

3 

7 

-1.48 

0.32 

0.10 

-0.51 

21721 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21721 

A 

1 

29 

64 

1.82 

0.20 

0.87 

0.57 

21721 

B 

0 

9 

20 

0.64 

0.29 

0.78 

-0.29 

21721 

C 

0 

7 

16 

0.14 

0.24 

0.44 

-0.44 

21721 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21722 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21722 

A 

1 

31 

70 

2.11 

0.30 

1.05 

0.54 

21722 

B 

0 

1 

2 

0.29 

0.00 

0.54 

-0.11 

21722 

C 

0 

9 

20 

0.37 

0.29 

0.85 

-0.34 

21722 

D 

0 

3 

7 

-0.82 

0.43 

0.21 

-0.37 

21723 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21723 

A 

1 

35 

78 

1.73 

0.20 

0.83 

0.50 

21723 

B 

0 

4 

9 

0.84 

0.45 

1.15 

-0.13 

21723 

C 

0 

4 

9 

0.06 

0.44 

0.52 

-0.32 

21723 

D 

0 

2 

4 

-0.92 

0.51 

0.17 

-0.39 

21724 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21724 

A 

1 

33 

72 

1.97 

0.21 

0.80 

0.57 

21724 

B 

0 

10 

22 

0.19 

0.36 

0.68 

-0.49 

21724 

C 

0 

2 

4 

0.09 

1.29 

0.69 

-0.21 

21724 

D 

0 

1 

2 

0.64 

0.00 

0.61 

-0.09 

21725 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21725 

A 

1 

27 

60 

2.36 

0.24 

0.69 

0.62 

21725 

B 

0 

10 

22 

0.31 

0.43 

1.03 

-0.44 

21725 

C 

0 

7 

16 

0.48 

0.42 

0.79 

-0.30 

21725 

D 

0 

1 

2 

0.68 

0.00 

0.58 

-0.09 

21726 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21726 

A 

1 

34 

76 

1.83 

0.23 

0.72 

0.61 

21726 

B 

0 

2 

4 

0.27 

0.46 

0.63 

-0.15 

21726 

C 

0 

8 

18 

-0.34 

0.25 

0.38 

-0.53 

21726 

D 

0 

1 

2 

-0.55 

0.00 

0.25 

-0.19 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21727 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21727 

A 

1 

30 

67 

1.79 

0.27 

0.83 

0.49 

21727 

B 

0 

13 

29 

0.44 

0.34 

1.34 

-0.28 

21727 

C 

0 

1 

2 

-1.17 

0.00 

0.13 

-0.21 

21727 

D 

0 

1 

2 

-4.30 

0.00 

0.01 

-0.48 

21728 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

21728 

A 

1 

35 

78 

1.56 

0.26 

0.99 

0.47 

21728 

B 

0 

3 

7 

-0.68 

1.21 

0.67 

-0.29 

21728 

C 

0 

6 

13 

0.08 

0.30 

0.78 

-0.25 

21728 

D 

0 

1 

2 

-2.01 

0.00 

0.08 

-0.28 

21729 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21729 

A 

1 

36 

80 

1.78 

0.24 

1.00 

0.53 

21729 

B 

0 

7 

16 

-0.24 

0.40 

0.53 

-0.44 

21729 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21729 

D 

0 

2 

4 

-0.36 

0.10 

0.33 

-0.24 

21730 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21730 

A 

1 

35 

78 

1.68 

0.18 

0.74 

0.53 

21730 

B 

0 

3 

7 

1.61 

0.67 

2.93 

0.06 

21730 

C 

0 

4 

9 

-0.67 

0.41 

0.27 

-0.47 

21730 

D 

0 

3 

7 

-0.73 

0.40 

0.23 

-0.41 

21731 

* 

-1 

3773 

95 

1.50 

0.02 

0.00 

-0.03 

21731 

A 

1 

195 

89 

1.81 

0.09 

1.06 

0.25 

21731 

B 

0 

15 

7 

0.54 

0.25 

0.83 

-0.25 

21731 

C 

0 

9 

4 

1.31 

0.30 

1.80 

-0.07 

21731 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21732 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21732 

A 

1 

39 

87 

1.71 

0.17 

0.88 

0.45 

21732 

B 

0 

3 

7 

0.20 

0.28 

0.45 

-0.30 

21732 

C 

0 

2 

4 

1.01 

0.05 

0.93 

-0.09 

21732 

D 

0 

1 

2 

-1.59 

0.00 

0.07 

-0.40 

21733 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21733 

A 

1 

33 

73 

1.79 

0.29 

0.93 

0.50 

21733 

B 

0 

8 

18 

-0.13 

0.35 

0.69 

-0.38 

21733 

C 

0 

3 

7 

0.07 

0.61 

0.78 

-0.19 

21733 

D 

0 

1 

2 

-0.95 

0.00 

0.21 

-0.20 

21734 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

0.00 

21734 

A 

1 

39 

89 

1.74 

0.19 

0.96 

0.36 

21734 

B 

0 

2 

5 

0.84 

0.38 

0.85 

-0.13 

21734 

C 

0 

2 

5 

0.21 

0.40 

0.45 

-0.25 

21734 

D 

0 

1 

2 

-0.33 

0.00 

0.25 

-0.24 

21735 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21735 

A 

1 

36 

82 

1.87 

0.19 

0.70 

0.58 

21735 

B 

0 

5 

11 

0.12 

0.55 

0.71 

-0.37 

21735 

C 

0 

2 

5 

-0.51 

0.81 

0.30 

-0.33 

21735 

D 

0 

1 

2 

-0.69 

0.00 

0.19 

-0.25 

21736 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

21736 

A 

1 

35 

76 

2.46 

0.26 

0.65 

0.62 

21736 

B 

0 

4 

9 

1.11 

0.27 

1.27 

-0.11 

21736 

C 

0 

5 

11 

-0.61 

0.42 

0.30 

-0.43 

21736 

D 

0 

2 

4 

-2.64 

1.37 

0.06 

-0.49 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21737 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21737 

A 

1 

40 

89 

1.77 

0.19 

0.77 

0.52 

21737 

B 

0 

1 

2 

-1.06 

0.00 

0.14 

-0.29 

21737 

C 

0 

4 

9 

-0.29 

0.44 

0.42 

-0.42 

21737 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21738 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21738 

A 

1 

34 

77 

2.07 

0.24 

0.69 

0.62 

21738 

B 

0 

4 

9 

-0.13 

0.69 

0.60 

-0.30 

21738 

C 

0 

5 

11 

-0.37 

0.52 

0.44 

-0.39 

21738 

D 

0 

1 

2 

-2.03 

0.00 

0.05 

-0.32 

21739 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21739 

A 

1 

35 

78 

1.58 

0.19 

0.97 

0.34 

21739 

B 

0 

8 

18 

0.67 

0.50 

2.03 

-0.27 

21739 

C 

0 

1 

2 

0.21 

0.00 

0.45 

-0.14 

21739 

D 

0 

1 

2 

0.27 

0.00 

0.48 

-0.14 

21740 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21740 

A 

1 

40 

87 

1.60 

0.20 

0.81 

0.42 

21740 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21740 

C 

0 

2 

4 

0.56 

0.41 

0.81 

-0.13 

21740 

D 

0 

4 

9 

-0.39 

0.79 

0.61 

-0.41 

21741 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21741 

A 

1 

36 

80 

1.99 

0.27 

1.04 

0.43 

21741 

B 

0 

1 

2 

-1.24 

0.00 

0.13 

-0.26 

21741 

C 

0 

5 

11 

0.75 

0.40 

1.22 

-0.19 

21741 

D 

0 

3 

7 

-0.30 

0.97 

0.71 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21742 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21742 

A 

1 

33 

73 

1.87 

0.25 

0.92 

0.48 

21742 

B 

0 

7 

16 

0.52 

0.33 

0.87 

-0.27 

21742 

C 

0 

3 

7 

0.46 

0.54 

0.82 

-0.18 

21742 

D 

0 

2 

4 

-0.73 

0.20 

0.19 

-0.32 

21743 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

21743 

A 

1 

38 

83 

1.46 

0.21 

0.86 

0.50 

21743 

B 

0 

4 

9 

-0.39 

0.43 

0.48 

-0.34 

21743 

C 

0 

2 

4 

-0.43 

0.56 

0.42 

-0.24 

21743 

D 

0 

2 

4 

-0.36 

0.08 

0.38 

-0.23 

21744 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21744 

A 

1 

36 

78 

1.72 

0.18 

0.79 

0.59 

21744 

B 

0 

6 

13 

0.09 

0.28 

0.50 

-0.39 

21744 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21744 

D 

0 

4 

9 

-0.22 

0.52 

0.45 

-0.39 

21745 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21745 

A 

1 

34 

76 

2.06 

0.24 

1.21 

0.51 

21745 

B 

0 

3 

7 

0.39 

1.07 

1.48 

-0.22 

21745 

C 

0 

5 

11 

0.47 

0.51 

0.93 

-0.27 

21745 

D 

0 

3 

7 

-0.28 

0.47 

0.30 

-0.33 

21746 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

21746 

A 

1 

25 

54 

1.99 

0.21 

0.66 

0.70 

21746 

B 

0 

17 

37 

0.29 

0.21 

0.60 

-0.48 

21746 

C 

0 

1 

2 

-1.01 

0.00 

0.13 

-0.24 

21746 

D 

0 

3 

7 

-0.54 

0.22 

0.21 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21747 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21747 

A 

1 

35 

78 

1.58 

0.20 

0.88 

0.44 

21747 

B 

0 

3 

7 

-0.21 

0.14 

0.33 

-0.32 

21747 

C 

0 

6 

13 

0.23 

0.54 

0.81 

-0.33 

21747 

D 

0 

1 

2 

1.61 

0.00 

2.00 

0.04 

21748 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21748 

A 

1 

36 

80 

2.23 

0.26 

0.96 

0.51 

21748 

B 

0 

6 

13 

0.49 

0.48 

1.01 

-0.30 

21748 

C 

0 

3 

7 

-0.86 

0.64 

0.22 

-0.41 

21748 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21749 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21749 

A 

1 

42 

91 

2.00 

0.23 

0.63 

0.56 

21749 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21749 

C 

0 

1 

2 

-0.16 

0.00 

0.44 

-0.16 

21749 

D 

0 

3 

7 

-1.75 

0.41 

0.10 

-0.54 

21750 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21750 

A 

1 

41 

91 

1.85 

0.25 

0.97 

0.39 

21750 

B 

0 

1 

2 

0.28 

0.00 

0.66 

-0.12 

21750 

C 

0 

1 

2 

-1.57 

0.00 

0.10 

-0.29 

21750 

D 

0 

2 

4 

-0.17 

0.66 

0.52 

-0.24 

21751 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

0.00 

21751 

A 

1 

41 

93 

1.72 

0.22 

0.85 

0.37 

21751 

B 

0 

1 

2 

-0.62 

0.00 

0.26 

-0.23 

21751 

C 

0 

1 

2 

-1.78 

0.00 

0.08 

-0.35 

21751 

D 

0 

1 

2 

1.00 

0.00 

1.29 

-0.06 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21752 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21752 

A 

1 

21 

47 

1.71 

0.33 

2.02 

0.05 

21752 

B 

0 

22 

49 

1.65 

0.21 

1.70 

0.01 

21752 

C 

0 

2 

4 

0.75 

0.85 

0.61 

-0.15 

21752 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21753 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21753 

A 

1 

33 

72 

1.97 

0.22 

1.18 

0.35 

21753 

B 

0 

9 

20 

1.27 

0.34 

1.38 

-0.16 

21753 

C 

0 

2 

4 

0.33 

0.97 

0.54 

-0.23 

21753 

D 

0 

2 

4 

0.38 

0.18 

0.38 

-0.22 

21754 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21754 

A 

1 

40 

87 

1.88 

0.24 

0.72 

0.51 

21754 

B 

0 

3 

7 

0.06 

0.67 

0.79 

-0.23 

21754 

C 

0 

1 

2 

0.15 

0.00 

0.62 

-0.12 

21754 

D 

0 

2 

4 

-2.14 

0.01 

0.06 

-0.47 

21755 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21755 

A 

1 

37 

82 

2.00 

0.26 

1.13 

0.53 

21755 

B 

0 

4 

9 

-0.20 

0.35 

0.45 

-0.33 

21755 

C 

0 

2 

4 

-0.34 

0.93 

0.48 

-0.25 

21755 

D 

0 

2 

4 

-0.70 

0.21 

0.24 

-0.29 

21756 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

21756 

A 

1 

40 

93 

1.53 

0.20 

0.67 

0.54 

21756 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21756 

C 

0 

2 

5 

-1.26 

0.13 

0.17 

-0.39 

21756 

D 

0 

1 

2 

-2.15 

0.00 

0.07 

-0.37 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21757 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21757 

A 

1 

36 

82 

1.64 

0.22 

0.77 

0.47 

21757 

B 

0 

2 

5 

0.06 

0.95 

0.74 

-0.18 

21757 

C 

0 

5 

11 

-0.71 

0.49 

0.36 

-0.49 

21757 

D 

0 

1 

2 

2.19 

0.00 

4.20 

0.09 

21758 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

21758 

A 

1 

41 

89 

1.34 

0.19 

1.00 

0.34 

21758 

B 

0 

1 

2 

0.02 

0.00 

0.52 

-0.14 

21758 

C 

0 

2 

4 

0.42 

0.54 

0.88 

-0.13 

21758 

D 

0 

2 

4 

-0.48 

0.03 

0.31 

-0.29 

21759 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21759 

A 

1 

37 

84 

1.80 

0.28 

1.28 

0.37 

21759 

B 

0 

5 

11 

0.47 

0.40 

1.04 

-0.22 

21759 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21759 

D 

0 

2 

5 

-0.89 

0.86 

0.29 

-0.31 

21760 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21760 

A 

1 

37 

84 

2.00 

0.22 

0.84 

0.49 

21760 

B 

0 

2 

5 

1.03 

0.16 

0.95 

-0.10 

21760 

C 

0 

1 

2 

-1.34 

0.00 

0.09 

-0.33 

21760 

D 

0 

4 

9 

-0.03 

0.21 

0.35 

-0.38 

21761 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21761 

A 

1 

41 

89 

1.55 

0.21 

0.81 

0.43 

21761 

B 

0 

3 

7 

0.18 

0.45 

0.79 

-0.21 

21761 

C 

0 

1 

2 

-0.61 

0.00 

0.30 

-0.20 

21761 

D 

0 

1 

2 

-2.41 

0.00 

0.05 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21762 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21762 

A 

1 

38 

83 

1.84 

0.20 

0.82 

0.58 

21762 

B 

0 

2 

4 

-0.05 

1.11 

0.68 

-0.22 

21762 

C 

0 

3 

7 

-0.98 

0.24 

0.17 

-0.45 

21762 

D 

0 

3 

7 

0.07 

0.13 

0.46 

-0.25 

21763 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21763 

A 

1 

35 

78 

1.59 

0.26 

1.00 

0.45 

21763 

B 

0 

4 

9 

-0.11 

0.42 

0.59 

-0.27 

21763 

C 

0 

2 

4 

0.79 

0.24 

1.18 

-0.06 

21763 

D 

0 

4 

9 

-0.38 

0.34 

0.42 

-0.33 

21764 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21764 

A 

1 

41 

91 

1.40 

0.17 

0.97 

0.33 

21764 

B 

0 

1 

2 

2.54 

0.00 

6.38 

0.16 

21764 

C 

0 

1 

2 

-1.62 

0.00 

0.10 

-0.36 

21764 

D 

0 

2 

4 

-0.48 

0.40 

0.34 

-0.31 

21765 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21765 

A 

1 

38 

84 

1.27 

0.22 

1.40 

0.15 

21765 

B 

0 

4 

9 

1.26 

0.76 

4.00 

0.02 

21765 

C 

0 

2 

4 

0.36 

1.00 

1.16 

-0.13 

21765 

D 

0 

1 

2 

-0.79 

0.00 

0.24 

-0.22 

21766 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21766 

A 

1 

42 

91 

1.61 

0.23 

0.85 

0.42 

21766 

B 

0 

2 

4 

-0.61 

0.04 

0.32 

-0.27 

21766 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21766 

D 

0 

2 

4 

-0.91 

0.29 

0.25 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21767 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21767 

A 

1 

41 

91 

1.99 

0.22 

0.96 

0.46 

21767 

B 

0 

1 

2 

-1.62 

0.00 

0.08 

-0.33 

21767 

C 

0 

2 

4 

-0.33 

0.35 

0.33 

-0.29 

21767 

D 

0 

1 

2 

0.19 

0.00 

0.52 

-0.15 

21768 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21768 

A 

1 

37 

82 

1.64 

0.18 

0.80 

0.58 

21768 

B 

0 

2 

4 

-0.07 

0.49 

0.46 

-0.23 

21768 

C 

0 

3 

7 

0.11 

0.46 

0.59 

-0.25 

21768 

D 

0 

3 

7 

-0.92 

0.40 

0.20 

-0.46 

21769 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21769 

A 

1 

36 

80 

1.61 

0.24 

0.90 

0.49 

21769 

B 

0 

3 

7 

-0.63 

0.39 

0.32 

-0.34 

21769 

C 

0 

4 

9 

-0.35 

0.20 

0.38 

-0.33 

21769 

D 

0 

2 

4 

0.64 

0.84 

1.34 

-0.09 

21770 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

21770 

A 

1 

33 

75 

1.52 

0.25 

1.47 

0.44 

21770 

B 

0 

3 

7 

0.46 

1.15 

2.14 

-0.12 

21770 

C 

0 

2 

5 

0.27 

0.41 

0.72 

-0.12 

21770 

D 

0 

6 

14 

-0.39 

0.54 

0.65 

-0.39 

21771 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21771 

A 

1 

37 

80 

1.84 

0.26 

0.86 

0.53 

21771 

B 

0 

4 

9 

-0.14 

1.00 

0.98 

-0.26 

21771 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21771 

D 

0 

5 

11 

-0.83 

0.46 

0.36 

-0.44 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21772 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21772 

A 

1 

39 

87 

1.94 

0.18 

0.80 

0.48 

21772 

B 

0 

3 

7 

1.08 

1.03 

2.24 

-0.12 

21772 

C 

0 

1 

2 

-0.57 

0.00 

0.19 

-0.26 

21772 

D 

0 

2 

4 

-1.03 

0.56 

0.14 

-0.45 

21773 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

21773 

A 

1 

43 

96 

1.94 

0.16 

0.99 

0.21 

21773 

B 

0 

1 

2 

1.36 

0.00 

0.94 

-0.07 

21773 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21773 

D 

0 

1 

2 

0.31 

0.00 

0.33 

-0.22 

21774 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21774 

A 

1 

36 

78 

1.91 

0.23 

0.91 

0.41 

21774 

B 

0 

3 

7 

1.85 

0.84 

4.74 

0.05 

21774 

C 

0 

5 

11 

-0.03 

0.42 

0.49 

-0.38 

21774 

D 

0 

2 

4 

-0.64 

0.55 

0.22 

-0.32 

21775 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21775 

A 

1 

40 

87 

1.66 

0.22 

1.17 

0.38 

21775 

B 

0 

3 

7 

0.69 

0.90 

1.97 

-0.14 

21775 

C 

0 

1 

2 

0.03 

0.00 

0.47 

-0.15 

21775 

D 

0 

2 

4 

-0.85 

0.12 

0.20 

-0.34 

21776 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21776 

A 

1 

38 

83 

1.88 

0.23 

0.77 

0.53 

21776 

B 

0 

4 

9 

-0.30 

0.61 

0.53 

-0.36 

21776 

C 

0 

4 

9 

-0.23 

0.15 

0.35 

-0.35 

21776 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21777 

* 

-1 

3945 

99 

1.52 

0.02 

0.00 

0.01 

21777 

A 

1 

37 

79 

1.81 

0.19 

0.79 

0.57 

21777 

B 

0 

5 

11 

-0.03 

0.29 

0.41 

-0.40 

21777 

C 

0 

4 

9 

-0.08 

0.25 

0.36 

-0.36 

21777 

D 

0 

1 

2 

0.82 

0.00 

0.81 

-0.07 

21778 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21778 

A 

1 

40 

87 

1.85 

0.19 

0.68 

0.60 

21778 

B 

0 

1 

2 

0.84 

0.00 

0.99 

-0.07 

21778 

C 

0 

4 

9 

-0.99 

0.09 

0.16 

-0.55 

21778 

D 

0 

1 

2 

-0.72 

0.00 

0.21 

-0.24 

21779 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21779 

A 

1 

38 

84 

1.86 

0.22 

1.00 

0.55 

21779 

B 

0 

1 

2 

0.21 

0.00 

0.57 

-0.12 

21779 

C 

0 

3 

7 

-0.84 

0.98 

0.51 

-0.40 

21779 

D 

0 

3 

7 

-0.44 

0.87 

0.61 

-0.33 

21780 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21780 

A 

1 

41 

91 

1.91 

0.25 

0.76 

0.44 

21780 

B 

0 

1 

2 

0.92 

0.00 

1.16 

-0.06 

21780 

C 

0 

2 

4 

0.32 

0.76 

0.83 

-0.15 

21780 

D 

0 

1 

2 

-5.44 

0.00 

0.00 

-0.57 

21781 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

0.00 

21781 

A 

1 

36 

84 

2.10 

0.28 

0.74 

0.59 

21781 

B 

0 

3 

7 

-0.26 

0.72 

0.75 

-0.26 

21781 

C 

0 

2 

5 

-1.68 

0.39 

0.13 

-0.37 

21781 

D 

0 

2 

5 

-1.63 

0.42 

0.14 

-0.36 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21782 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21782 

A 

1 

39 

87 

2.17 

0.24 

0.83 

0.56 

21782 

B 

0 

2 

4 

-0.90 

0.35 

0.19 

-0.34 

21782 

C 

0 

3 

7 

-0.69 

0.42 

0.25 

-0.39 

21782 

D 

0 

1 

2 

0.09 

0.00 

0.47 

-0.15 

21783 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21783 

A 

1 

41 

91 

1.48 

0.15 

0.64 

0.62 

21783 

B 

0 

1 

2 

-0.24 

0.00 

0.43 

-0.17 

21783 

C 

0 

2 

4 

-0.81 

0.69 

0.30 

-0.33 

21783 

D 

0 

1 

2 

-3.85 

0.00 

0.01 

-0.58 

21784 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21784 

A 

1 

39 

87 

1.89 

0.21 

0.63 

0.61 

21784 

B 

0 

2 

4 

-0.68 

0.11 

0.25 

-0.31 

21784 

C 

0 

1 

2 

-1.20 

0.00 

0.15 

-0.27 

21784 

D 

0 

3 

7 

-0.90 

0.49 

0.24 

-0.42 

21785 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.00 

21785 

A 

1 

39 

91 

1.79 

0.25 

0.95 

0.46 

21785 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21785 

C 

0 

3 

7 

-0.78 

0.29 

0.27 

-0.39 

21785 

D 

0 

1 

2 

-0.87 

0.00 

0.23 

-0.23 

21786 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21786 

A 

1 

42 

91 

1.88 

0.22 

0.82 

0.43 

21786 

B 

0 

2 

4 

0.01 

0.51 

0.49 

-0.24 

21786 

C 

0 

1 

2 

-0.28 

0.00 

0.33 

-0.19 

21786 

D 

0 

1 

2 

-1.43 

0.00 

0.10 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21787 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21787 

A 

1 

34 

76 

1.76 

0.20 

0.65 

0.67 

21787 

B 

0 

4 

9 

-0.53 

0.61 

0.46 

-0.35 

21787 

C 

0 

4 

9 

-0.40 

0.58 

0.49 

-0.32 

21787 

D 

0 

3 

7 

-0.98 

0.72 

0.31 

-0.38 

21788 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

21788 

A 

1 

40 

87 

2.14 

0.25 

0.76 

0.49 

21788 

B 

0 

1 

2 

-1.43 

0.00 

0.09 

-0.28 

21788 

C 

0 

1 

2 

0.71 

0.00 

0.78 

-0.10 

21788 

D 

0 

4 

9 

-0.34 

0.63 

0.49 

-0.39 

21789 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21789 

A 

1 

39 

87 

1.67 

0.21 

0.83 

0.50 

21789 

B 

0 

1 

2 

-1.04 

0.00 

0.18 

-0.25 

21789 

C 

0 

1 

2 

0.07 

0.00 

0.53 

-0.14 

21789 

D 

0 

4 

9 

-0.48 

0.68 

0.58 

-0.40 

21790 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21790 

A 

1 

41 

91 

1.78 

0.17 

0.81 

0.52 

21790 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21790 

C 

0 

2 

4 

-0.53 

0.66 

0.26 

-0.37 

21790 

D 

0 

2 

4 

-0.35 

0.15 

0.26 

-0.34 

21791 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

21791 

A 

1 

36 

80 

1.60 

0.23 

0.74 

0.55 

21791 

B 

0 

2 

4 

0.32 

0.99 

1.22 

-0.12 

21791 

C 

0 

3 

7 

-1.02 

0.37 

0.23 

-0.38 

21791 

D 

0 

4 

9 

-0.59 

0.53 

0.48 

-0.36 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21792 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21792 

A 

1 

37 

80 

1.68 

0.26 

1.26 

0.20 

21792 

B 

0 

8 

17 

1.07 

0.55 

2.56 

-0.13 

21792 

C 

0 

1 

2 

-0.56 

0.00 

0.24 

-0.20 

21792 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21793 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21793 

A 

1 

39 

87 

1.89 

0.20 

0.78 

0.51 

21793 

B 

0 

1 

2 

0.17 

0.00 

0.42 

-0.16 

21793 

C 

0 

3 

7 

-0.29 

0.59 

0.35 

-0.38 

21793 

D 

0 

2 

4 

-0.11 

0.33 

0.34 

-0.28 

21794 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21794 

A 

1 

42 

93 

1.84 

0.19 

0.93 

0.37 

21794 

B 

0 

2 

4 

0.54 

0.81 

0.85 

-0.20 

21794 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21794 

D 

0 

1 

2 

-1.27 

0.00 

0.10 

-0.35 

21795 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21795 

A 

1 

40 

89 

1.70 

0.21 

0.90 

0.38 

21795 

B 

0 

2 

4 

-1.10 

0.98 

0.22 

-0.41 

21795 

C 

0 

3 

7 

0.74 

0.61 

1.25 

-0.15 

21795 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21796 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.04 

21796 

A 

1 

37 

84 

1.51 

0.20 

0.58 

0.70 

21796 

B 

0 

2 

5 

-1.06 

0.26 

0.28 

-0.25 

21796 

C 

0 

1 

2 

0.03 

0.00 

0.80 

-0.08 

21796 

D 

0 

4 

9 

-2.71 

0.91 

0.18 

-0.66 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21797 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21797 

A 

1 

37 

82 

1.55 

0.23 

0.84 

0.54 

21797 

B 

0 

3 

7 

-0.80 

0.27 

0.28 

-0.35 

21797 

C 

0 

2 

4 

0.10 

0.60 

0.76 

-0.15 

21797 

D 

0 

3 

7 

-0.77 

0.05 

0.27 

-0.35 

21798 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

21798 

A 

1 

40 

91 

1.33 

0.20 

0.84 

0.33 

21798 

B 

0 

1 

2 

0.62 

0.00 

1.07 

-0.06 

21798 

C 

0 

1 

2 

1.43 

0.00 

2.41 

0.03 

21798 

D 

0 

2 

5 

-1.69 

2.60 

0.72 

-0.43 

21799 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21799 

A 

1 

22 

48 

2.88 

0.28 

0.52 

0.74 

21799 

B 

0 

13 

28 

0.77 

0.24 

0.65 

-0.36 

21799 

C 

0 

8 

17 

0.30 

0.30 

0.39 

-0.40 

21799 

D 

0 

3 

7 

0.32 

0.26 

0.33 

-0.23 

21800 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21800 

A 

1 

33 

73 

2.46 

0.24 

0.66 

0.62 

21800 

B 

0 

4 

9 

1.12 

0.65 

1.90 

-0.12 

21800 

C 

0 

3 

7 

-0.97 

0.57 

0.15 

-0.42 

21800 

D 

0 

5 

11 

-0.33 

0.58 

0.37 

-0.43 

21801 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21801 

A 

1 

13 

29 

2.47 

0.48 

1.27 

0.46 

21801 

B 

0 

8 

18 

0.76 

0.45 

1.48 

-0.18 

21801 

C 

0 

12 

27 

1.20 

0.32 

1.23 

-0.06 

21801 

D 

0 

12 

27 

0.68 

0.38 

0.87 

-0.26 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21802 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21802 

A 

1 

31 

70 

1.75 

0.24 

0.98 

0.27 

21802 

B 

0 

9 

20 

1.21 

0.58 

3.27 

-0.08 

21802 

C 

0 

1 

2 

2.27 

0.00 

3.29 

0.08 

21802 

D 

0 

3 

7 

-0.90 

1.63 

1.22 

-0.40 

21803 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21803 

A 

1 

10 

22 

3.69 

0.34 

0.34 

0.71 

21803 

B 

0 

9 

20 

0.97 

0.29 

0.42 

-0.32 

21803 

C 

0 

26 

58 

1.45 

0.19 

0.84 

-0.34 

21803 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21804 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.00 

21804 

A 

1 

36 

84 

1.66 

0.27 

0.96 

0.30 

21804 

B 

0 

1 

2 

-0.25 

0.00 

0.39 

-0.16 

21804 

C 

0 

6 

14 

0.45 

0.54 

2.01 

-0.25 

21804 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21805 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21805 

A 

1 

16 

36 

2.23 

0.37 

0.98 

0.51 

21805 

B 

0 

23 

51 

0.89 

0.17 

0.86 

-0.34 

21805 

C 

0 

2 

4 

1.76 

0.69 

1.96 

0.07 

21805 

D 

0 

4 

9 

-0.02 

0.55 

0.44 

-0.32 

21806 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21806 

A 

1 

9 

20 

1.84 

0.45 

2.97 

0.18 

21806 

B 

0 

19 

42 

1.42 

0.19 

1.06 

-0.03 

21806 

C 

0 

10 

22 

1.23 

0.44 

1.23 

-0.11 

21806 

D 

0 

7 

16 

1.39 

0.35 

0.97 

-0.03 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21807 

* 

-1 

3744 

94 

1.51 

0.02 

0.00 

-0.01 

21807 

A 

1 

74 

30 

2.39 

0.13 

1.04 

0.47 

21807 

B 

0 

119 

48 

1.21 

0.08 

0.87 

-0.33 

21807 

C 

0 

51 

21 

1.31 

0.14 

0.97 

-0.13 

21807 

D 

0 

4 

2 

1.53 

0.31 

0.91 

-0.01 

21808 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21808 

A 

1 

14 

31 

3.23 

0.32 

0.57 

0.67 

21808 

B 

0 

19 

42 

1.26 

0.22 

0.75 

-0.33 

21808 

C 

0 

5 

11 

0.85 

0.44 

0.53 

-0.24 

21808 

D 

0 

7 

16 

1.19 

0.55 

1.22 

-0.19 

21809 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21809 

A 

1 

9 

20 

2.60 

0.63 

1.74 

0.32 

21809 

B 

0 

8 

18 

2.24 

0.54 

2.57 

0.17 

21809 

C 

0 

21 

47 

1.39 

0.20 

0.89 

-0.23 

21809 

D 

0 

7 

16 

1.03 

0.39 

0.65 

-0.22 

21810 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21810 

A 

1 

11 

24 

2.29 

0.43 

1.30 

0.34 

21810 

B 

0 

6 

13 

0.82 

0.72 

0.97 

-0.17 

21810 

C 

0 

14 

30 

1.71 

0.30 

1.41 

0.13 

21810 

D 

0 

15 

33 

0.78 

0.33 

0.62 

-0.32 

21811 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

21811 

A 

1 

12 

26 

1.68 

0.68 

4.92 

0.23 

21811 

B 

0 

28 

61 

1.23 

0.14 

1.18 

0.09 

21811 

C 

0 

3 

7 

-0.55 

0.81 

0.25 

-0.30 

21811 

D 

0 

3 

7 

-0.46 

0.40 

0.20 

-0.28 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21812 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21812 

A 

1 

20 

44 

2.63 

0.36 

0.99 

0.65 

21812 

B 

0 

19 

42 

0.80 

0.16 

0.77 

-0.32 

21812 

C 

0 

3 

7 

0.20 

0.18 

0.35 

-0.20 

21812 

D 

0 

3 

7 

-1.41 

0.60 

0.10 

-0.46 

21813 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21813 

A 

1 

39 

87 

1.61 

0.24 

0.93 

0.31 

21813 

B 

0 

3 

7 

0.96 

1.07 

3.48 

-0.07 

21813 

C 

0 

1 

2 

0.59 

0.00 

0.90 

-0.07 

21813 

D 

0 

2 

4 

-1.52 

2.50 

0.67 

-0.38 

21814 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21814 

A 

1 

37 

82 

1.62 

0.20 

0.91 

0.32 

21814 

B 

0 

3 

7 

0.93 

0.47 

1.20 

-0.10 

21814 

C 

0 

3 

7 

0.27 

1.05 

1.17 

-0.24 

21814 

D 

0 

2 

4 

0.33 

1.83 

1.68 

-0.18 

21815 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

21815 

A 

1 

8 

18 

2.37 

0.67 

4.39 

0.33 

21815 

B 

0 

12 

27 

0.86 

0.36 

0.72 

-0.15 

21815 

C 

0 

18 

41 

1.59 

0.31 

1.42 

0.17 

21815 

D 

0 

6 

14 

-0.43 

0.54 

0.19 

-0.42 

21816 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.03 

21816 

A 

1 

37 

84 

2.39 

0.24 

0.76 

0.57 

21816 

B 

0 

3 

7 

-0.25 

0.63 

0.36 

-0.37 

21816 

C 

0 

3 

7 

-0.14 

0.59 

0.40 

-0.35 

21816 

D 

0 

1 

2 

-0.10 

0.00 

0.30 

-0.19 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21817 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

21817 

A 

1 

16 

36 

2.17 

0.40 

0.85 

0.55 

21817 

B 

0 

20 

44 

0.75 

0.19 

0.98 

-0.17 

21817 

C 

0 

4 

9 

-1.23 

0.61 

0.15 

-0.46 

21817 

D 

0 

5 

11 

0.38 

0.38 

0.60 

-0.15 

21818 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

21818 

A 

1 

12 

27 

2.13 

0.44 

1.80 

0.43 

21818 

B 

0 

28 

64 

0.90 

0.23 

0.97 

-0.24 

21818 

C 

0 

2 

5 

0.14 

0.15 

0.26 

-0.16 

21818 

D 

0 

2 

5 

-0.02 

0.75 

0.29 

-0.19 

21819 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21819 

A 

1 

19 

43 

2.66 

0.36 

1.01 

0.52 

21819 

B 

0 

3 

7 

0.65 

0.68 

0.53 

-0.18 

21819 

C 

0 

21 

48 

1.13 

0.28 

1.10 

-0.35 

21819 

D 

0 

1 

2 

-0.62 

0.00 

0.11 

-0.22 

21820 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21820 

A 

1 

22 

49 

2.39 

0.35 

1.23 

0.46 

21820 

B 

0 

16 

36 

1.12 

0.32 

1.20 

-0.22 

21820 

C 

0 

3 

7 

-0.15 

0.53 

0.25 

-0.29 

21820 

D 

0 

4 

9 

0.68 

0.97 

1.01 

-0.18 

21821 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21821 

A 

1 

9 

20 

3.14 

0.46 

0.52 

0.60 

21821 

B 

0 

15 

33 

1.42 

0.29 

1.28 

0.03 

21821 

C 

0 

16 

35 

0.78 

0.23 

0.63 

-0.29 

21821 

D 

0 

6 

13 

0.08 

0.59 

0.44 

-0.34 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21822 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21822 

A 

1 

11 

24 

2.38 

0.72 

4.32 

0.37 

21822 

B 

0 

17 

38 

0.72 

0.28 

0.75 

-0.22 

21822 

C 

0 

7 

16 

1.57 

0.67 

2.82 

0.09 

21822 

D 

0 

10 

22 

0.51 

0.47 

0.88 

-0.21 

21823 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21823 

A 

1 

35 

78 

1.76 

0.22 

1.01 

0.37 

21823 

B 

0 

2 

4 

0.38 

0.78 

0.68 

-0.19 

21823 

C 

0 

4 

9 

0.82 

0.60 

1.29 

-0.16 

21823 

D 

0 

4 

9 

0.51 

0.48 

0.76 

-0.24 

21824 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.02 

21824 

A 

1 

16 

36 

3.29 

0.38 

0.95 

0.59 

21824 

B 

0 

24 

55 

1.18 

0.26 

0.94 

-0.31 

21824 

C 

0 

3 

7 

0.00 

1.13 

0.44 

-0.24 

21824 

D 

0 

1 

2 

-4.30 

0.00 

0.00 

-0.47 

21825 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

21825 

A 

1 

16 

36 

1.79 

0.30 

1.00 

0.47 

21825 

B 

0 

22 

50 

0.61 

0.21 

0.89 

-0.35 

21825 

C 

0 

3 

7 

0.54 

0.93 

1.03 

-0.11 

21825 

D 

0 

3 

7 

0.60 

0.78 

1.09 

-0.10 

21826 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21826 

A 

1 

42 

91 

1.87 

0.23 

0.79 

0.43 

21826 

B 

0 

2 

4 

-0.51 

1.53 

0.63 

-0.29 

21826 

C 

0 

2 

4 

-0.61 

0.34 

0.25 

-0.30 

21826 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21827 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21827 

A 

1 

11 

25 

3.03 

0.67 

3.67 

0.49 

21827 

B 

0 

20 

45 

1.27 

0.24 

0.99 

-0.22 

21827 

C 

0 

5 

11 

1.59 

0.46 

1.14 

-0.02 

21827 

D 

0 

8 

18 

0.79 

0.43 

0.75 

-0.25 

21828 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

0.00 

21828 

A 

1 

16 

36 

2.41 

0.34 

1.84 

0.47 

21828 

B 

0 

17 

39 

1.24 

0.27 

1.02 

-0.20 

21828 

C 

0 

7 

16 

0.63 

0.50 

0.63 

-0.30 

21828 

D 

0 

4 

9 

1.31 

0.35 

0.73 

-0.06 

21829 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21829 

A 

1 

10 

22 

2.53 

0.58 

3.57 

0.40 

21829 

B 

0 

5 

11 

0.55 

0.67 

0.68 

-0.19 

21829 

C 

0 

25 

56 

1.44 

0.20 

1.21 

0.04 

21829 

D 

0 

5 

11 

-0.41 

0.79 

0.29 

-0.41 

21830 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21830 

A 

1 

14 

31 

2.81 

0.34 

1.12 

0.61 

21830 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21830 

C 

0 

24 

53 

1.22 

0.22 

0.92 

-0.27 

21830 

D 

0 

7 

16 

0.29 

0.17 

0.24 

-0.40 

21831 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21831 

A 

1 

11 

24 

2.61 

0.63 

4.68 

0.42 

21831 

B 

0 

23 

50 

1.04 

0.28 

1.28 

-0.21 

21831 

C 

0 

3 

7 

1.08 

0.56 

0.79 

-0.05 

21831 

D 

0 

9 

20 

0.88 

0.49 

0.90 

-0.15 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21832 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21832 

A 

1 

22 

49 

2.63 

0.30 

0.71 

0.66 

21832 

B 

0 

11 

24 

1.03 

0.21 

0.81 

-0.22 

21832 

C 

0 

5 

11 

0.67 

0.31 

0.56 

-0.22 

21832 

D 

0 

7 

16 

-0.02 

0.35 

0.31 

-0.46 

21833 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21833 

A 

1 

26 

57 

2.12 

0.27 

1.09 

0.49 

21833 

B 

0 

15 

33 

0.87 

0.25 

0.85 

-0.32 

21833 

C 

0 

2 

4 

0.64 

1.05 

0.78 

-0.13 

21833 

D 

0 

3 

7 

0.17 

0.79 

0.51 

-0.25 

21834 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21834 

A 

1 

9 

20 

3.04 

0.52 

0.82 

0.59 

21834 

B 

0 

18 

40 

1.30 

0.25 

1.13 

-0.08 

21834 

C 

0 

11 

24 

0.55 

0.21 

0.36 

-0.36 

21834 

D 

0 

7 

16 

1.07 

0.45 

0.78 

-0.11 

21835 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21835 

A 

1 

16 

35 

2.48 

0.47 

1.92 

0.49 

21835 

B 

0 

20 

43 

1.13 

0.20 

1.20 

-0.19 

21835 

C 

0 

4 

9 

0.87 

0.46 

0.86 

-0.12 

21835 

D 

0 

6 

13 

0.22 

0.50 

0.58 

-0.31 

21836 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21836 

A 

1 

11 

25 

3.27 

0.35 

0.48 

0.64 

21836 

B 

0 

6 

14 

2.33 

0.27 

1.75 

0.18 

21836 

C 

0 

20 

45 

0.97 

0.25 

0.58 

-0.44 

21836 

D 

0 

7 

16 

0.58 

0.29 

0.32 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21837 

* 

-1 

3811 

95 

1.50 

0.02 

0.00 

-0.05 

21837 

A 

1 

67 

37 

2.85 

0.16 

1.12 

0.53 

21837 

B 

0 

55 

30 

1.20 

0.15 

0.73 

-0.30 

21837 

C 

0 

50 

28 

1.40 

0.16 

1.00 

-0.20 

21837 

D 

0 

9 

5 

1.01 

0.54 

0.89 

-0.14 

21838 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21838 

A 

1 

11 

24 

2.96 

0.49 

1.20 

0.48 

21838 

B 

0 

8 

18 

0.72 

0.28 

0.38 

-0.28 

21838 

C 

0 

18 

40 

1.46 

0.28 

1.04 

-0.10 

21838 

D 

0 

8 

18 

1.20 

0.71 

1.79 

-0.13 

21839 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21839 

A 

1 

34 

76 

2.04 

0.24 

0.82 

0.61 

21839 

B 

0 

2 

4 

-0.14 

0.48 

0.37 

-0.23 

21839 

C 

0 

3 

7 

-0.06 

0.53 

0.49 

-0.27 

21839 

D 

0 

6 

13 

-0.24 

0.36 

0.43 

-0.44 

21840 

* 

-1 

3789 

95 

1.51 

0.02 

0.00 

-0.03 

21840 

A 

1 

59 

29 

2.73 

0.18 

1.37 

0.48 

21840 

B 

0 

45 

22 

1.20 

0.16 

0.87 

-0.19 

21840 

C 

0 

93 

46 

1.39 

0.11 

0.92 

-0.20 

21840 

D 

0 

6 

3 

-0.11 

0.86 

0.57 

-0.23 

21841 

* 

-1 

3944 

99 

1.52 

0.02 

0.00 

0.02 

21841 

A 

1 

34 

71 

1.47 

0.19 

1.24 

0.38 

21841 

B 

0 

9 

19 

0.62 

0.29 

0.96 

-0.23 

21841 

C 

0 

2 

4 

0.54 

0.39 

0.70 

-0.12 

21841 

D 

0 

3 

6 

0.13 

1.02 

0.94 

-0.24 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21842 

* 

-1 

3811 

95 

1.50 

0.02 

0.00 

-0.06 

21842 

A 

1 

166 

92 

2.06 

0.11 

0.98 

0.28 

21842 

B 

0 

5 

3 

1.15 

0.51 

1.67 

-0.09 

21842 

C 

0 

8 

4 

0.62 

0.48 

1.66 

-0.20 

21842 

D 

0 

2 

1 

-0.89 

0.33 

0.13 

-0.21 

21843 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

21843 

A 

1 

10 

22 

3.92 

0.51 

0.60 

0.73 

21843 

B 

0 

23 

50 

1.07 

0.16 

0.57 

-0.48 

21843 

C 

0 

2 

4 

0.51 

0.17 

0.25 

-0.18 

21843 

D 

0 

11 

24 

1.65 

0.28 

1.07 

-0.06 

21844 

* 

-1 

3794 

95 

1.52 

0.02 

0.00 

0.01 

21844 

A 

1 

57 

29 

2.21 

0.17 

1.34 

0.42 

21844 

B 

0 

119 

60 

1.14 

0.09 

0.94 

-0.30 

21844 

C 

0 

17 

9 

1.32 

0.22 

1.07 

-0.03 

21844 

D 

0 

5 

3 

-0.20 

0.80 

0.75 

-0.22 

21845 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21845 

A 

1 

30 

65 

1.81 

0.22 

0.90 

0.52 

21845 

B 

0 

6 

13 

0.49 

0.38 

0.73 

-0.25 

21845 

C 

0 

3 

7 

-0.10 

0.47 

0.37 

-0.30 

21845 

D 

0 

7 

15 

0.60 

0.38 

0.89 

-0.24 

21846 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21846 

A 

1 

4 

9 

3.00 

1.00 

1.13 

0.35 

21846 

B 

0 

37 

80 

1.37 

0.19 

1.11 

-0.01 

21846 

C 

0 

5 

11 

0.15 

0.86 

0.67 

-0.30 

21846 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21847 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21847 

A 

1 

6 

13 

2.16 

0.63 

2.02 

0.21 

21847 

B 

0 

33 

73 

1.54 

0.16 

0.94 

-0.05 

21847 

C 

0 

4 

9 

0.82 

0.87 

0.74 

-0.21 

21847 

D 

0 

2 

4 

1.85 

1.30 

1.74 

0.05 

21848 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

21848 

A 

1 

5 

11 

3.31 

1.22 

5.44 

0.33 

21848 

B 

0 

38 

83 

1.69 

0.23 

1.08 

-0.05 

21848 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21848 

D 

0 

3 

7 

-0.44 

0.26 

0.06 

-0.34 

21849 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21849 

A 

1 

6 

14 

3.59 

0.68 

0.54 

0.57 

21849 

B 

0 

31 

70 

1.25 

0.21 

0.99 

-0.15 

21849 

C 

0 

2 

5 

-0.64 

0.01 

0.08 

-0.29 

21849 

D 

0 

5 

11 

0.48 

0.57 

0.42 

-0.21 

21850 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

21850 

A 

1 

6 

13 

1.87 

0.82 

4.27 

0.23 

21850 

B 

0 

3 

7 

-0.50 

0.52 

0.16 

-0.26 

21850 

C 

0 

31 

69 

1.23 

0.19 

1.08 

0.22 

21850 

D 

0 

5 

11 

-0.55 

1.08 

0.37 

-0.36 

21851 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

21851 

A 

1 

2 

4 

5.59 

1.81 

0.33 

0.51 

21851 

B 

0 

39 

85 

1.71 

0.22 

1.17 

-0.10 

21851 

C 

0 

5 

11 

0.80 

0.55 

0.27 

-0.21 

21851 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21852 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

21852 

A 

1 

8 

18 

3.27 

0.78 

5.48 

0.42 

21852 

B 

0 

4 

9 

1.22 

0.53 

0.53 

-0.07 

21852 

C 

0 

29 

66 

1.53 

0.28 

1.32 

-0.07 

21852 

D 

0 

3 

7 

-1.30 

0.42 

0.03 

-0.43 

21853 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21853 

A 

1 

7 

16 

3.29 

0.25 

0.32 

0.60 

21853 

B 

0 

36 

80 

1.25 

0.17 

0.79 

-0.38 

21853 

C 

0 

2 

4 

-0.40 

1.38 

0.19 

-0.32 

21853 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21854 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21854 

A 

1 

20 

44 

2.81 

0.36 

0.77 

0.62 

21854 

B 

0 

15 

33 

0.90 

0.21 

0.80 

-0.26 

21854 

C 

0 

3 

7 

-0.16 

0.72 

0.36 

-0.26 

21854 

D 

0 

7 

16 

0.16 

0.74 

1.01 

-0.33 

21855 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21855 

A 

1 

5 

11 

2.86 

1.04 

6.53 

0.29 

21855 

B 

0 

19 

42 

1.87 

0.26 

1.04 

0.17 

21855 

C 

0 

13 

29 

0.99 

0.53 

0.78 

-0.22 

21855 

D 

0 

8 

18 

0.84 

0.46 

0.60 

-0.20 

21856 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21856 

A 

1 

20 

44 

2.24 

0.36 

1.04 

0.52 

21856 

B 

0 

11 

24 

0.74 

0.25 

0.76 

-0.22 

21856 

C 

0 

11 

24 

0.90 

0.36 

1.18 

-0.16 

21856 

D 

0 

3 

7 

-0.86 

0.40 

0.14 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21857 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

0.00 

21857 

A 

1 

13 

28 

2.50 

0.57 

3.97 

0.41 

21857 

B 

0 

21 

46 

0.93 

0.19 

0.65 

-0.40 

21857 

C 

0 

9 

20 

1.89 

0.28 

1.70 

0.11 

21857 

D 

0 

3 

7 

0.86 

0.27 

0.45 

-0.13 

21858 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21858 

A 

1 

22 

49 

2.41 

0.37 

1.33 

0.58 

21858 

B 

0 

11 

24 

1.01 

0.15 

0.89 

-0.11 

21858 

C 

0 

8 

18 

-0.46 

0.41 

0.44 

-0.47 

21858 

D 

0 

4 

9 

0.03 

0.78 

0.60 

-0.23 

21859 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

21859 

A 

1 

17 

38 

2.53 

0.48 

1.79 

0.41 

21859 

B 

0 

11 

24 

0.81 

0.32 

0.62 

-0.25 

21859 

C 

0 

6 

13 

1.36 

0.32 

0.98 

-0.05 

21859 

D 

0 

11 

24 

1.07 

0.60 

1.87 

-0.17 

21860 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21860 

A 

1 

16 

36 

2.58 

0.33 

0.95 

0.59 

21860 

B 

0 

18 

41 

0.80 

0.30 

1.00 

-0.28 

21860 

C 

0 

4 

9 

0.70 

0.66 

0.64 

-0.13 

21860 

D 

0 

6 

14 

0.03 

0.64 

0.47 

-0.32 

21861 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

0.00 

21861 

A 

1 

20 

45 

2.91 

0.40 

0.93 

0.66 

21861 

B 

0 

21 

48 

0.52 

0.20 

0.91 

-0.55 

21861 

C 

0 

2 

5 

0.50 

1.59 

1.23 

-0.13 

21861 

D 

0 

1 

2 

-0.45 

0.00 

0.19 

-0.17 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21862 

* 

-1 

3942 

99 

1.52 

0.02 

0.00 

0.00 

21862 

A 

1 

21 

42 

2.54 

0.44 

1.03 

0.52 

21862 

B 

0 

11 

22 

0.77 

0.23 

0.80 

-0.23 

21862 

C 

0 

15 

30 

1.06 

0.20 

1.07 

-0.17 

21862 

D 

0 

3 

6 

-0.95 

0.31 

0.12 

-0.36 

21863 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.03 

21863 

A 

1 

37 

86 

1.28 

0.20 

0.83 

0.41 

21863 

B 

0 

2 

5 

-0.77 

0.04 

0.28 

-0.30 

21863 

C 

0 

1 

2 

-1.24 

0.00 

0.18 

-0.26 

21863 

D 

0 

3 

7 

0.27 

1.18 

1.76 

-0.16 

21864 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21864 

A 

1 

23 

50 

2.29 

0.31 

0.74 

0.62 

21864 

B 

0 

11 

24 

0.53 

0.25 

0.74 

-0.32 

21864 

C 

0 

8 

17 

0.42 

0.27 

0.64 

-0.30 

21864 

D 

0 

4 

9 

0.28 

0.18 

0.47 

-0.23 

21865 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21865 

A 

1 

17 

38 

2.06 

0.38 

1.13 

0.46 

21865 

B 

0 

17 

38 

0.65 

0.24 

0.77 

-0.28 

21865 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21865 

D 

0 

11 

24 

0.66 

0.45 

1.27 

-0.20 

21866 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21866 

A 

1 

26 

59 

2.11 

0.27 

1.55 

0.46 

21866 

B 

0 

4 

9 

0.37 

0.47 

0.53 

-0.25 

21866 

C 

0 

9 

20 

1.17 

0.50 

1.59 

-0.13 

21866 

D 

0 

5 

11 

0.26 

0.41 

0.48 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21867 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.02 

21867 

A 

1 

21 

49 

2.24 

0.27 

0.68 

0.68 

21867 

B 

0 

7 

16 

0.09 

0.36 

0.48 

-0.36 

21867 

C 

0 

4 

9 

0.84 

0.50 

0.96 

-0.09 

21867 

D 

0 

11 

26 

0.27 

0.25 

0.57 

-0.41 

21868 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21868 

A 

1 

14 

31 

2.59 

0.47 

1.78 

0.50 

21868 

B 

0 

6 

13 

0.83 

0.42 

0.68 

-0.17 

21868 

C 

0 

25 

56 

1.00 

0.24 

0.99 

-0.35 

21868 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21869 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

21869 

A 

1 

15 

33 

2.42 

0.35 

1.09 

0.40 

21869 

B 

0 

20 

44 

1.32 

0.29 

1.30 

-0.14 

21869 

C 

0 

6 

13 

0.39 

0.65 

0.55 

-0.30 

21869 

D 

0 

4 

9 

1.28 

1.07 

2.12 

-0.06 

21870 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.05 

21870 

A 

1 

7 

16 

2.74 

0.77 

1.36 

0.48 

21870 

B 

0 

29 

64 

0.82 

0.23 

1.06 

-0.06 

21870 

C 

0 

4 

9 

0.14 

0.78 

0.71 

-0.14 

21870 

D 

0 

5 

11 

-0.62 

0.55 

0.20 

-0.33 

21871 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21871 

A 

1 

19 

43 

2.31 

0.48 

1.74 

0.43 

21871 

B 

0 

21 

48 

0.95 

0.21 

1.20 

-0.29 

21871 

C 

0 

1 

2 

0.07 

0.00 

0.32 

-0.12 

21871 

D 

0 

3 

7 

0.18 

1.11 

0.74 

-0.20 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21872 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

21872 

A 

1 

18 

40 

2.48 

0.26 

0.53 

0.68 

21872 

B 

0 

17 

38 

0.56 

0.21 

0.70 

-0.26 

21872 

C 

0 

6 

13 

0.26 

0.55 

0.62 

-0.20 

21872 

D 

0 

4 

9 

-1.39 

0.91 

0.17 

-0.48 

21873 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

21873 

A 

1 

26 

58 

1.82 

0.24 

0.85 

0.60 

21873 

B 

0 

9 

20 

0.07 

0.38 

0.65 

-0.33 

21873 

C 

0 

2 

4 

1.04 

0.02 

1.09 

0.00 

21873 

D 

0 

8 

18 

-0.30 

0.44 

0.48 

-0.43 

21874 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21874 

A 

1 

16 

36 

2.99 

0.29 

0.55 

0.77 

21874 

B 

0 

22 

49 

0.74 

0.18 

0.61 

-0.46 

21874 

C 

0 

2 

4 

0.02 

0.13 

0.22 

-0.21 

21874 

D 

0 

5 

11 

0.19 

0.42 

0.37 

-0.30 

21875 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21875 

A 

1 

38 

86 

1.67 

0.23 

1.07 

0.32 

21875 

B 

0 

2 

5 

-0.40 

0.85 

0.38 

-0.30 

21875 

C 

0 

2 

5 

0.54 

0.47 

0.79 

-0.15 

21875 

D 

0 

2 

5 

0.95 

0.14 

1.07 

-0.09 

21876 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21876 

A 

1 

16 

36 

2.19 

0.29 

1.25 

0.38 

21876 

B 

0 

14 

31 

0.88 

0.51 

1.37 

-0.22 

21876 

C 

0 

7 

16 

1.76 

0.47 

2.30 

0.10 

21876 

D 

0 

8 

18 

0.40 

0.42 

0.44 

-0.30 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21877 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21877 

A 

1 

8 

18 

2.30 

0.55 

2.15 

0.31 

21877 

B 

0 

1 

2 

1.70 

0.00 

0.88 

0.04 

21877 

C 

0 

24 

55 

1.36 

0.20 

0.95 

0.01 

21877 

D 

0 

11 

25 

0.59 

0.61 

0.83 

-0.30 

21878 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21878 

A 

1 

13 

28 

2.87 

0.43 

1.05 

0.55 

21878 

B 

0 

28 

61 

1.12 

0.16 

0.82 

-0.41 

21878 

C 

0 

3 

7 

-0.61 

0.41 

0.11 

-0.40 

21878 

D 

0 

2 

4 

3.42 

0.61 

6.35 

0.27 

21879 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21879 

A 

-1 

1 

2 

5.47 

0.00 

0.00 

0.39 

21879 

B 

-1 

39 

87 

1.60 

0.21 

0.00 

0.23 

21879 

C 

-1 

1 

2 

1.75 

0.00 

0.00 

0.03 

21879 

D 

-1 

4 

9 

-1.00 

0.34 

0.00 

-0.49 

21880 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

21880 

A 

1 

2 

5 

1.61 

2.65 

17.48 

0.03 

21880 

B 

0 

36 

82 

1.62 

0.26 

1.30 

0.27 

21880 

C 

0 

1 

2 

0.01 

0.00 

0.08 

-0.13 

21880 

D 

0 

5 

11 

0.15 

0.51 

0.14 

-0.28 

21881 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21881 

A 

1 

16 

36 

3.14 

0.46 

1.04 

0.68 

21881 

B 

0 

19 

42 

0.56 

0.24 

0.78 

-0.40 

21881 

C 

0 

5 

11 

-0.30 

0.50 

0.34 

-0.33 

21881 

D 

0 

5 

11 

1.02 

0.38 

0.97 

-0.08 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21882 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

21882 

A 

1 

42 

95 

1.41 

0.20 

0.83 

0.36 

21882 

B 

0 

1 

2 

0.03 

0.00 

0.59 

-0.14 

21882 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21882 

D 

0 

1 

2 

-2.04 

0.00 

0.07 

-0.37 

21883 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21883 

A 

1 

27 

60 

1.91 

0.26 

1.04 

0.50 

21883 

B 

0 

6 

13 

0.67 

0.57 

1.13 

-0.17 

21883 

C 

0 

7 

16 

0.26 

0.28 

0.53 

-0.30 

21883 

D 

0 

5 

11 

0.24 

0.84 

1.14 

-0.25 

21884 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

21884 

A 

1 

24 

52 

2.73 

0.33 

0.92 

0.62 

21884 

B 

0 

7 

15 

0.58 

0.40 

0.72 

-0.28 

21884 

C 

0 

12 

26 

0.74 

0.32 

0.94 

-0.33 

21884 

D 

0 

3 

7 

-0.03 

0.45 

0.30 

-0.27 

21885 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21885 

A 

1 

23 

51 

2.16 

0.31 

1.67 

0.49 

21885 

B 

0 

15 

33 

0.85 

0.21 

0.76 

-0.35 

21885 

C 

0 

2 

4 

0.90 

0.03 

0.62 

-0.10 

21885 

D 

0 

5 

11 

0.81 

0.46 

0.77 

-0.19 

21886 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21886 

A 

1 

19 

42 

2.11 

0.27 

1.01 

0.53 

21886 

B 

0 

5 

11 

0.21 

0.53 

0.48 

-0.24 

21886 

C 

0 

18 

40 

0.85 

0.17 

0.74 

-0.20 

21886 

D 

0 

3 

7 

-0.70 

1.94 

0.99 

-0.35 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21887 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21887 

A 

1 

27 

61 

1.96 

0.28 

1.50 

0.39 

21887 

B 

0 

3 

7 

0.22 

0.62 

0.45 

-0.25 

21887 

C 

0 

11 

25 

1.19 

0.31 

1.39 

-0.14 

21887 

D 

0 

3 

7 

0.17 

0.56 

0.44 

-0.26 

21888 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21888 

A 

1 

23 

51 

2.35 

0.29 

0.76 

0.63 

21888 

B 

0 

15 

33 

0.50 

0.22 

0.66 

-0.47 

21888 

C 

0 

2 

4 

0.56 

0.29 

0.53 

-0.13 

21888 

D 

0 

5 

11 

0.60 

0.30 

0.62 

-0.21 

21889 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21889 

A 

1 

19 

42 

3.04 

0.30 

0.46 

0.74 

21889 

B 

0 

20 

44 

0.42 

0.25 

0.57 

-0.54 

21889 

C 

0 

3 

7 

-0.11 

0.44 

0.26 

-0.24 

21889 

D 

0 

3 

7 

0.59 

1.17 

1.40 

-0.14 

21890 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21890 

A 

1 

26 

58 

2.46 

0.24 

0.78 

0.60 

21890 

B 

0 

8 

18 

0.68 

0.56 

2.10 

-0.23 

21890 

C 

0 

2 

4 

-0.51 

0.99 

0.23 

-0.25 

21890 

D 

0 

9 

20 

0.13 

0.67 

0.72 

-0.40 

21891 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

21891 

A 

1 

23 

51 

1.83 

0.31 

1.42 

0.37 

21891 

B 

0 

7 

16 

0.87 

0.25 

0.84 

-0.15 

21891 

C 

0 

10 

22 

0.66 

0.26 

0.78 

-0.27 

21891 

D 

0 

5 

11 

1.17 

0.76 

2.04 

-0.05 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21892 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

21892 

A 

1 

27 

60 

1.76 

0.25 

1.31 

0.29 

21892 

B 

0 

13 

29 

1.27 

0.25 

1.48 

-0.10 

21892 

C 

0 

1 

2 

-0.03 

0.00 

0.26 

-0.19 

21892 

D 

0 

4 

9 

0.59 

0.63 

0.81 

-0.23 

21893 

* 

-1 

3937 

99 

1.52 

0.02 

0.00 

0.00 

21893 

A 

1 

24 

44 

2.25 

0.26 

0.94 

0.50 

21893 

B 

0 

3 

5 

0.77 

0.21 

0.50 

-0.13 

21893 

C 

0 

26 

47 

1.04 

0.22 

1.07 

-0.33 

21893 

D 

0 

2 

4 

-0.41 

0.43 

0.16 

-0.28 

21894 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

21894 

A 

1 

18 

41 

2.46 

0.35 

0.64 

0.62 

21894 

B 

0 

11 

25 

-0.17 

0.27 

0.40 

-0.50 

21894 

C 

0 

10 

23 

0.54 

0.27 

0.76 

-0.23 

21894 

D 

0 

5 

11 

1.41 

0.66 

3.62 

0.04 

21895 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

21895 

A 

1 

38 

86 

1.78 

0.22 

0.94 

0.39 

21895 

B 

0 

4 

9 

-0.37 

0.55 

0.42 

-0.43 

21895 

C 

0 

1 

2 

1.61 

0.00 

1.85 

0.01 

21895 

D 

0 

1 

2 

0.82 

0.00 

0.84 

-0.08 

21896 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

21896 

A 

1 

20 

44 

1.82 

0.23 

0.92 

0.47 

21896 

B 

0 

2 

4 

0.92 

1.54 

1.67 

-0.06 

21896 

C 

0 

21 

47 

0.88 

0.19 

0.90 

-0.30 

21896 

D 

0 

2 

4 

-0.56 

0.01 

0.16 

-0.35 

easyCBM  CCSS  Second  Grade  Math  Measure  Development 


301 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

21897 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

21897 

A 

1 

40 

87 

1.74 

0.22 

0.90 

0.43 

21897 

B 

0 

4 

9 

-0.44 

0.68 

0.61 

-0.38 

21897 

C 

0 

1 

2 

1.55 

0.00 

2.32 

0.01 

21897 

D 

0 

1 

2 

-1.21 

0.00 

0.15 

-0.26 

21898 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

0.00 

21898 

A 

1 

37 

84 

1.89 

0.25 

1.21 

0.45 

21898 

B 

0 

3 

7 

1.20 

0.67 

2.22 

-0.06 

21898 

C 

0 

2 

5 

-0.97 

0.29 

0.19 

-0.33 

21898 

D 

0 

2 

5 

-1.40 

0.13 

0.12 

-0.39 

21899 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

21899 

A 

1 

17 

39 

1.47 

0.34 

2.20 

0.20 

21899 

B 

0 

22 

50 

1.14 

0.21 

1.33 

-0.02 

21899 

C 

0 

2 

5 

0.99 

0.09 

0.71 

-0.03 

21899 

D 

0 

3 

7 

-0.24 

0.98 

0.41 

-0.32 

21900 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

21900 

A 

1 

21 

46 

2.32 

0.26 

0.79 

0.59 

21900 

B 

0 

5 

11 

1.14 

0.35 

1.00 

-0.07 

21900 

C 

0 

19 

41 

0.73 

0.20 

0.73 

-0.42 

21900 

D 

0 

1 

2 

-2.65 

0.00 

0.02 

-0.44 

22001 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22001 

A 

1 

40 

89 

2.02 

0.20 

0.83 

0.50 

22001 

B 

0 

1 

2 

1.30 

0.00 

1.35 

-0.05 

22001 

C 

0 

2 

4 

-0.26 

1.16 

0.49 

-0.30 

22001 

D 

0 

2 

4 

-1.15 

0.68 

0.14 

-0.43 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22002 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

22002 

A 

1 

42 

91 

1.82 

0.21 

0.95 

0.38 

22002 

B 

0 

2 

4 

0.21 

0.16 

0.57 

-0.21 

22002 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22002 

D 

0 

2 

4 

-0.54 

1.87 

0.89 

-0.31 

22003 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

22003 

A 

1 

42 

91 

1.24 

0.24 

1.26 

0.26 

22003 

B 

0 

3 

7 

-0.13 

0.52 

0.90 

-0.21 

22003 

C 

0 

1 

2 

-0.38 

0.00 

0.53 

-0.15 

22003 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22004 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

22004 

A 

1 

44 

96 

1.60 

0.23 

0.91 

0.32 

22004 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22004 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22004 

D 

0 

2 

4 

-0.87 

1.38 

0.58 

-0.32 

22005 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22005 

A 

1 

35 

76 

1.57 

0.21 

0.94 

0.37 

22005 

B 

0 

5 

11 

0.43 

0.23 

0.69 

-0.24 

22005 

C 

0 

4 

9 

0.82 

0.89 

2.92 

-0.12 

22005 

D 

0 

2 

4 

-0.22 

0.08 

0.33 

-0.25 

22006 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22006 

A 

1 

41 

91 

1.52 

0.22 

0.83 

0.32 

22006 

B 

0 

1 

2 

-2.18 

0.00 

0.07 

-0.35 

22006 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22006 

D 

0 

3 

7 

0.47 

1.26 

3.19 

-0.16 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22007 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

22007 

A 

1 

41 

91 

1.67 

0.21 

1.09 

0.22 

22007 

B 

0 

3 

7 

0.62 

0.38 

0.80 

-0.19 

22007 

C 

0 

1 

2 

0.67 

0.00 

0.74 

-0.10 

22007 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22008 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22008 

A 

1 

41 

91 

1.69 

0.27 

0.89 

0.33 

22008 

B 

0 

3 

7 

-0.94 

0.68 

0.37 

-0.37 

22008 

C 

0 

1 

2 

1.46 

0.00 

2.64 

0.00 

22008 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22009 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22009 

A 

1 

42 

91 

1.49 

0.21 

0.88 

0.45 

22009 

B 

0 

2 

4 

-0.62 

0.03 

0.33 

-0.28 

22009 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22009 

D 

0 

2 

4 

-1.04 

0.83 

0.29 

-0.34 

22010 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22010 

A 

1 

36 

80 

1.85 

0.26 

1.15 

0.36 

22010 

B 

0 

5 

11 

0.00 

0.62 

0.77 

-0.34 

22010 

C 

0 

2 

4 

1.63 

1.02 

3.34 

0.01 

22010 

D 

0 

2 

4 

0.14 

0.31 

0.50 

-0.19 

22011 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22011 

A 

1 

42 

93 

1.28 

0.18 

0.93 

0.34 

22011 

B 

0 

2 

4 

-0.69 

0.44 

0.29 

-0.34 

22011 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22011 

D 

0 

1 

2 

0.32 

0.00 

0.73 

-0.11 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22012 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22012 

A 

1 

41 

93 

1.71 

0.22 

0.97 

0.44 

22012 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22012 

C 

0 

1 

2 

-1.22 

0.00 

0.16 

-0.28 

22012 

D 

0 

2 

5 

-0.79 

0.42 

0.26 

-0.33 

22013 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

22013 

A 

1 

39 

85 

1.72 

0.22 

0.73 

0.53 

22013 

B 

0 

4 

9 

-0.18 

0.34 

0.49 

-0.32 

22013 

C 

0 

2 

4 

-0.72 

1.06 

0.39 

-0.30 

22013 

D 

0 

1 

2 

-1.34 

0.00 

0.13 

-0.27 

22014 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

22014 

A 

1 

38 

86 

1.42 

0.19 

0.86 

0.50 

22014 

B 

0 

1 

2 

-1.00 

0.00 

0.21 

-0.25 

22014 

C 

0 

4 

9 

-0.17 

0.73 

1.00 

-0.32 

22014 

D 

0 

1 

2 

-1.39 

0.00 

0.14 

-0.29 

22015 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22015 

A 

1 

34 

76 

1.63 

0.23 

1.22 

0.32 

22015 

B 

0 

2 

4 

0.20 

0.65 

0.53 

-0.19 

22015 

C 

0 

5 

11 

1.18 

0.32 

1.44 

-0.05 

22015 

D 

0 

4 

9 

0.16 

0.58 

0.61 

-0.29 

22016 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22016 

A 

1 

40 

89 

1.47 

0.20 

0.74 

0.53 

22016 

B 

0 

1 

2 

0.70 

0.00 

1.29 

-0.05 

22016 

C 

0 

2 

4 

-1.01 

0.21 

0.24 

-0.31 

22016 

D 

0 

2 

4 

-2.14 

1.63 

0.20 

-0.47 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22017 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22017 

A 

1 

39 

87 

1.74 

0.24 

0.94 

0.44 

22017 

B 

0 

1 

2 

2.78 

0.00 

9.16 

0.12 

22017 

C 

0 

1 

2 

0.49 

0.00 

0.92 

-0.08 

22017 

D 

0 

4 

9 

-1.66 

0.80 

0.22 

-0.55 

22018 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22018 

A 

1 

38 

84 

1.63 

0.24 

0.89 

0.48 

22018 

B 

0 

4 

9 

-0.01 

0.26 

0.60 

-0.26 

22018 

C 

0 

2 

4 

-1.30 

0.79 

0.20 

-0.36 

22018 

D 

0 

1 

2 

-0.38 

0.00 

0.37 

-0.16 

22019 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22019 

A 

1 

44 

98 

1.44 

0.19 

0.48 

0.54 

22019 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22019 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22019 

D 

0 

1 

2 

-3.85 

0.00 

0.02 

-0.54 

22020 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22020 

A 

1 

40 

89 

1.31 

0.24 

0.94 

0.41 

22020 

B 

0 

1 

2 

0.12 

0.00 

0.89 

-0.09 

22020 

C 

0 

3 

7 

-0.60 

0.96 

1.02 

-0.28 

22020 

D 

0 

1 

2 

-2.05 

0.00 

0.10 

-0.30 

22021 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22021 

A 

1 

40 

89 

1.38 

0.20 

0.91 

0.48 

22021 

B 

0 

1 

2 

-0.16 

0.00 

0.49 

-0.15 

22021 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22021 

D 

0 

4 

9 

-0.78 

0.31 

0.30 

-0.45 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22022 

* 

-1 

3951 

99 

1.52 

0.02 

0.00 

0.02 

22022 

A 

1 

36 

88 

1.48 

0.24 

0.89 

0.48 

22022 

B 

0 

2 

5 

-1.24 

1.41 

0.43 

-0.35 

22022 

C 

0 

2 

5 

0.21 

0.14 

0.86 

-0.14 

22022 

D 

0 

1 

2 

-2.05 

0.00 

0.09 

-0.33 

22023 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22023 

A 

1 

34 

76 

1.67 

0.21 

1.15 

0.35 

22023 

B 

0 

4 

9 

0.61 

0.60 

1.20 

-0.19 

22023 

C 

0 

6 

13 

0.93 

0.65 

2.18 

-0.14 

22023 

D 

0 

1 

2 

-1.50 

0.00 

0.08 

-0.33 

22024 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

22024 

A 

1 

45 

98 

1.71 

0.23 

1.03 

0.23 

22024 

B 

0 

1 

2 

-0.71 

0.00 

0.27 

-0.23 

22024 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22024 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22025 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22025 

A 

1 

41 

91 

1.36 

0.23 

0.81 

0.51 

22025 

B 

0 

1 

2 

-0.57 

0.00 

0.49 

-0.14 

22025 

C 

0 

2 

4 

-0.64 

0.39 

0.50 

-0.21 

22025 

D 

0 

1 

2 

-5.44 

0.00 

0.00 

-0.55 

22026 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

22026 

A 

1 

43 

93 

1.79 

0.19 

0.87 

0.29 

22026 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22026 

C 

0 

3 

7 

0.25 

1.10 

1.41 

-0.29 

22026 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22027 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22027 

A 

-1 

45 

100 

1.32 

0.20 

0.00 

0.00 

22027 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

22027 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

22027 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

22028 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22028 

A 

1 

44 

98 

1.47 

0.22 

1.01 

0.23 

22028 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22028 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22028 

D 

0 

1 

2 

-0.75 

0.00 

0.29 

-0.23 

22029 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22029 

A 

1 

40 

87 

1.45 

0.22 

1.03 

0.37 

22029 

B 

0 

1 

2 

1.28 

0.00 

1.97 

0.00 

22029 

C 

0 

2 

4 

-0.05 

0.21 

0.53 

-0.19 

22029 

D 

0 

3 

7 

-0.69 

0.83 

0.52 

-0.35 

22030 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.00 

22030 

A 

1 

41 

95 

1.57 

0.20 

0.77 

0.40 

22030 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22030 

C 

0 

1 

2 

0.22 

0.00 

0.68 

-0.13 

22030 

D 

0 

1 

2 

-2.41 

0.00 

0.05 

-0.42 

22031 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

22031 

A 

1 

38 

83 

1.75 

0.22 

1.05 

0.49 

22031 

B 

0 

4 

9 

-0.02 

0.24 

0.48 

-0.31 

22031 

C 

0 

4 

9 

-0.24 

0.59 

0.53 

-0.36 

22031 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22032 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.05 

22032 

A 

1 

36 

82 

1.16 

0.24 

0.96 

0.41 

22032 

B 

0 

3 

7 

0.38 

0.10 

1.04 

-0.09 

22032 

C 

0 

3 

7 

-0.31 

0.23 

0.55 

-0.22 

22032 

D 

0 

2 

5 

-1.76 

0.81 

0.16 

-0.39 

22033 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

22033 

A 

1 

43 

96 

1.90 

0.20 

1.07 

0.13 

22033 

B 

0 

1 

2 

0.62 

0.00 

0.59 

-0.14 

22033 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22033 

D 

0 

1 

2 

1.55 

0.00 

1.49 

-0.04 

22034 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

22034 

A 

-1 

45 

100 

1.89 

0.23 

0.00 

0.00 

22034 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

22034 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

22034 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

22035 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22035 

A 

1 

43 

98 

1.60 

0.31 

1.91 

0.35 

22035 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22035 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22035 

D 

0 

1 

2 

-3.53 

0.00 

0.10 

-0.35 

22036 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22036 

A 

1 

44 

98 

1.72 

0.25 

1.04 

0.15 

22036 

B 

0 

1 

2 

0.04 

0.00 

0.55 

-0.15 

22036 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22036 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22037 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

22037 

A 

1 

37 

84 

1.39 

0.22 

1.01 

0.42 

22037 

B 

0 

3 

7 

-0.07 

0.34 

0.59 

-0.23 

22037 

C 

0 

4 

9 

-0.31 

0.56 

0.71 

-0.32 

22037 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22038 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22038 

A 

1 

43 

98 

1.51 

0.21 

0.99 

0.19 

22038 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22038 

C 

0 

1 

2 

-0.28 

0.00 

0.37 

-0.19 

22038 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22039 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

22039 

A 

1 

45 

98 

1.21 

0.17 

0.28 

0.66 

22039 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22039 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22039 

D 

0 

1 

2 

-5.44 

0.00 

0.01 

-0.66 

22040 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22040 

A 

1 

42 

93 

1.44 

0.20 

0.96 

0.32 

22040 

B 

0 

2 

4 

-0.74 

0.35 

0.27 

-0.33 

22040 

C 

0 

1 

2 

0.72 

0.00 

1.09 

-0.07 

22040 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22041 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22041 

A 

-1 

45 

100 

1.65 

0.26 

0.00 

0.00 

22041 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

22041 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

22041 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22042 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22042 

A 

1 

35 

76 

1.78 

0.25 

1.05 

0.50 

22042 

B 

0 

4 

9 

0.87 

0.51 

1.46 

-0.07 

22042 

C 

0 

2 

4 

0.12 

1.46 

1.11 

-0.14 

22042 

D 

0 

5 

11 

-1.34 

0.89 

0.36 

-0.52 

22043 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

22043 

A 

1 

39 

85 

1.80 

0.25 

0.85 

0.46 

22043 

B 

0 

2 

4 

-0.70 

0.32 

0.23 

-0.29 

22043 

C 

0 

2 

4 

0.61 

0.44 

0.90 

-0.12 

22043 

D 

0 

3 

7 

-0.52 

0.52 

0.34 

-0.33 

22044 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

22044 

A 

1 

40 

91 

1.32 

0.26 

1.11 

0.26 

22044 

B 

0 

2 

5 

-0.17 

0.48 

0.65 

-0.18 

22044 

C 

0 

1 

2 

-1.13 

0.00 

0.22 

-0.22 

22044 

D 

0 

1 

2 

0.99 

0.00 

1.86 

-0.02 

22045 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22045 

A 

1 

40 

89 

2.11 

0.24 

0.58 

0.60 

22045 

B 

0 

2 

4 

-0.12 

0.24 

0.45 

-0.21 

22045 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22045 

D 

0 

3 

7 

-2.27 

0.98 

0.11 

-0.57 

22046 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22046 

A 

1 

35 

78 

1.66 

0.21 

0.89 

0.44 

22046 

B 

0 

3 

7 

0.73 

0.30 

0.86 

-0.13 

22046 

C 

0 

3 

7 

0.96 

0.68 

1.62 

-0.08 

22046 

D 

0 

4 

9 

-0.56 

0.51 

0.29 

-0.46 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22047 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22047 

A 

1 

32 

71 

2.05 

0.24 

0.62 

0.69 

22047 

B 

0 

3 

7 

-0.36 

0.81 

0.60 

-0.27 

22047 

C 

0 

2 

4 

-0.79 

0.54 

0.23 

-0.27 

22047 

D 

0 

8 

18 

-0.45 

0.31 

0.38 

-0.50 

22048 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22048 

A 

1 

37 

82 

1.93 

0.29 

0.87 

0.50 

22048 

B 

0 

3 

7 

-0.13 

0.36 

0.58 

-0.23 

22048 

C 

0 

1 

2 

1.18 

0.00 

1.91 

-0.03 

22048 

D 

0 

4 

9 

-1.19 

0.14 

0.19 

-0.45 

22049 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22049 

A 

1 

30 

65 

1.88 

0.28 

1.25 

0.49 

22049 

B 

0 

5 

11 

0.88 

0.25 

1.02 

-0.09 

22049 

C 

0 

8 

17 

0.02 

0.47 

0.56 

-0.37 

22049 

D 

0 

3 

7 

-0.34 

0.88 

0.58 

-0.27 

22050 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22050 

A 

-1 

45 

100 

1.58 

0.24 

0.00 

0.00 

22050 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

22050 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

22050 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

22051 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

22051 

A 

1 

29 

66 

1.73 

0.27 

1.04 

0.46 

22051 

B 

0 

4 

9 

-0.20 

0.28 

0.39 

-0.26 

22051 

C 

0 

7 

16 

1.03 

0.29 

1.48 

-0.04 

22051 

D 

0 

4 

9 

-1.24 

1.28 

0.64 

-0.45 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22052 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

22052 

A 

1 

33 

75 

1.97 

0.20 

0.75 

0.61 

22052 

B 

0 

4 

9 

0.18 

0.24 

0.43 

-0.27 

22052 

C 

0 

3 

7 

0.74 

0.10 

0.69 

-0.13 

22052 

D 

0 

4 

9 

-1.08 

0.97 

0.26 

-0.54 

22053 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22053 

A 

1 

33 

73 

1.81 

0.22 

0.74 

0.55 

22053 

B 

0 

5 

11 

0.45 

0.47 

0.85 

-0.22 

22053 

C 

0 

2 

4 

0.53 

0.16 

0.67 

-0.12 

22053 

D 

0 

5 

11 

-0.60 

0.32 

0.26 

-0.48 

22054 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22054 

A 

1 

31 

67 

1.91 

0.24 

1.08 

0.56 

22054 

B 

0 

7 

15 

0.27 

0.29 

0.62 

-0.28 

22054 

C 

0 

1 

2 

-0.99 

0.00 

0.14 

-0.22 

22054 

D 

0 

7 

15 

-0.03 

0.66 

0.79 

-0.36 

22055 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

22055 

A 

1 

34 

77 

2.02 

0.22 

0.86 

0.45 

22055 

B 

0 

5 

11 

0.70 

0.63 

1.14 

-0.24 

22055 

C 

0 

2 

5 

-0.19 

1.96 

0.91 

-0.28 

22055 

D 

0 

3 

7 

0.49 

0.36 

0.56 

-0.22 

22056 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

22056 

A 

1 

36 

82 

1.72 

0.19 

0.75 

0.54 

22056 

B 

0 

5 

11 

0.05 

0.15 

0.43 

-0.37 

22056 

C 

0 

3 

7 

-0.39 

1.19 

1.01 

-0.37 

22056 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22057 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22057 

A 

1 

39 

87 

2.10 

0.21 

0.84 

0.48 

22057 

B 

0 

3 

7 

0.03 

0.65 

0.45 

-0.34 

22057 

C 

0 

3 

7 

0.14 

0.21 

0.37 

-0.32 

22057 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22058 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22058 

A 

1 

39 

87 

1.64 

0.22 

0.88 

0.42 

22058 

B 

0 

1 

2 

0.98 

0.00 

1.20 

-0.04 

22058 

C 

0 

3 

7 

-0.30 

0.40 

0.38 

-0.32 

22058 

D 

0 

2 

4 

-0.46 

0.47 

0.32 

-0.28 

22059 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22059 

A 

1 

34 

77 

2.22 

0.26 

0.60 

0.66 

22059 

B 

0 

5 

11 

-0.72 

0.64 

0.62 

-0.44 

22059 

C 

0 

3 

7 

-0.72 

0.14 

0.24 

-0.33 

22059 

D 

0 

2 

5 

-0.80 

0.53 

0.25 

-0.27 

22060 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22060 

A 

1 

36 

78 

1.74 

0.25 

0.88 

0.50 

22060 

B 

0 

3 

7 

0.65 

0.65 

1.28 

-0.10 

22060 

C 

0 

5 

11 

0.01 

0.35 

0.54 

-0.26 

22060 

D 

0 

2 

4 

-2.74 

1.78 

0.17 

-0.50 

22061 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22061 

A 

1 

31 

69 

1.60 

0.26 

0.90 

0.48 

22061 

B 

0 

5 

11 

-0.31 

0.40 

0.48 

-0.34 

22061 

C 

0 

6 

13 

0.18 

0.47 

0.95 

-0.25 

22061 

D 

0 

3 

7 

0.42 

0.60 

1.03 

-0.13 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22062 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

22062 

A 

1 

37 

84 

1.48 

0.21 

0.80 

0.50 

22062 

B 

0 

3 

7 

0.10 

0.44 

0.73 

-0.19 

22062 

C 

0 

3 

7 

-0.08 

0.77 

0.88 

-0.22 

22062 

D 

0 

1 

2 

-4.30 

0.00 

0.01 

-0.54 

22063 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22063 

A 

1 

42 

93 

1.50 

0.21 

0.81 

0.48 

22063 

B 

0 

1 

2 

-0.50 

0.00 

0.38 

-0.19 

22063 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22063 

D 

0 

2 

4 

-1.75 

0.40 

0.12 

-0.45 

22064 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

22064 

A 

1 

42 

95 

1.43 

0.24 

0.96 

0.33 

22064 

B 

0 

1 

2 

0.18 

0.00 

0.97 

-0.11 

22064 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22064 

D 

0 

1 

2 

-2.40 

0.00 

0.07 

-0.35 

22065 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22065 

A 

1 

40 

89 

1.48 

0.20 

1.09 

0.34 

22065 

B 

0 

1 

2 

0.39 

0.00 

0.72 

-0.11 

22065 

C 

0 

4 

9 

-0.03 

0.62 

0.74 

-0.32 

22065 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22066 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22066 

A 

1 

34 

76 

1.57 

0.24 

1.10 

0.31 

22066 

B 

0 

3 

7 

0.90 

0.09 

1.00 

-0.09 

22066 

C 

0 

3 

7 

-0.05 

0.28 

0.42 

-0.28 

22066 

D 

0 

5 

11 

0.84 

0.44 

1.37 

-0.13 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22067 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22067 

A 

1 

31 

69 

1.92 

0.21 

0.81 

0.54 

22067 

B 

0 

4 

9 

-0.32 

0.80 

0.48 

-0.40 

22067 

C 

0 

6 

13 

0.90 

0.33 

1.01 

-0.15 

22067 

D 

0 

4 

9 

0.14 

0.45 

0.50 

-0.30 

22068 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22068 

A 

1 

41 

91 

1.46 

0.22 

1.12 

0.38 

22068 

B 

0 

3 

7 

-0.38 

0.37 

0.47 

-0.30 

22068 

C 

0 

1 

2 

-0.90 

0.00 

0.25 

-0.22 

22068 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22069 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22069 

A 

1 

38 

84 

1.82 

0.23 

1.08 

0.22 

22069 

B 

0 

5 

11 

1.62 

0.56 

2.83 

-0.01 

22069 

C 

0 

1 

2 

0.92 

0.00 

0.89 

-0.07 

22069 

D 

0 

1 

2 

-2.81 

0.00 

0.02 

-0.45 

22070 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.01 

22070 

A 

1 

35 

81 

1.86 

0.25 

1.03 

0.33 

22070 

B 

0 

2 

5 

0.48 

0.01 

0.58 

-0.17 

22070 

C 

0 

3 

7 

1.39 

0.70 

2.41 

-0.04 

22070 

D 

0 

3 

7 

-0.06 

0.32 

0.38 

-0.31 

22071 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

22071 

A 

1 

33 

72 

1.49 

0.22 

0.88 

0.46 

22071 

B 

0 

3 

7 

0.67 

0.69 

1.49 

-0.08 

22071 

C 

0 

7 

15 

0.43 

0.21 

0.82 

-0.21 

22071 

D 

0 

3 

7 

-1.28 

0.77 

0.22 

-0.46 

easyCBM  CCSS  Second  Grade  Math  Measure  Development 


316 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22072 

* 

-1 

3808 

95 

1.49 

0.02 

0.00 

-0.07 

22072 

A 

1 

163 

89 

2.20 

0.11 

1.29 

0.37 

22072 

B 

0 

15 

8 

0.66 

0.20 

0.69 

-0.28 

22072 

C 

0 

5 

3 

0.21 

0.20 

0.35 

-0.21 

22072 

D 

0 

1 

1 

0.21 

0.00 

0.33 

-0.09 

22073 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22073 

A 

1 

40 

89 

2.09 

0.23 

0.79 

0.50 

22073 

B 

0 

2 

4 

-0.86 

0.41 

0.17 

-0.36 

22073 

C 

0 

1 

2 

-0.03 

0.00 

0.37 

-0.17 

22073 

D 

0 

2 

4 

-0.25 

0.25 

0.31 

-0.28 

22074 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22074 

A 

1 

27 

60 

2.11 

0.23 

0.66 

0.65 

22074 

B 

0 

5 

11 

0.44 

0.27 

0.65 

-0.18 

22074 

C 

0 

4 

9 

1.21 

0.62 

2.34 

-0.01 

22074 

D 

0 

9 

20 

-0.86 

0.41 

0.35 

-0.65 

22075 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22075 

A 

1 

33 

73 

1.70 

0.25 

1.13 

0.46 

22075 

B 

0 

5 

11 

0.10 

0.34 

0.59 

-0.30 

22075 

C 

0 

1 

2 

0.26 

0.00 

0.54 

-0.11 

22075 

D 

0 

6 

13 

0.30 

0.39 

0.86 

-0.28 

22076 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22076 

A 

1 

36 

80 

2.29 

0.21 

0.69 

0.68 

22076 

B 

0 

5 

11 

0.01 

0.27 

0.37 

-0.36 

22076 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22076 

D 

0 

4 

9 

-1.26 

0.87 

0.28 

-0.55 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22077 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

22077 

A 

1 

36 

78 

2.06 

0.25 

0.94 

0.45 

22077 

B 

0 

3 

7 

0.42 

0.88 

1.08 

-0.22 

22077 

C 

0 

7 

15 

0.34 

0.35 

0.71 

-0.37 

22077 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22078 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.02 

22078 

A 

1 

39 

89 

2.03 

0.22 

0.83 

0.41 

22078 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22078 

C 

0 

3 

7 

0.65 

1.22 

2.69 

-0.21 

22078 

D 

0 

2 

5 

-0.72 

0.21 

0.18 

-0.37 

22079 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22079 

A 

1 

40 

89 

1.72 

0.22 

0.93 

0.37 

22079 

B 

0 

2 

4 

-0.08 

0.17 

0.41 

-0.24 

22079 

C 

0 

1 

2 

0.83 

0.00 

1.01 

-0.07 

22079 

D 

0 

2 

4 

-0.25 

0.81 

0.46 

-0.27 

22080 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

22080 

A 

1 

35 

80 

1.52 

0.26 

1.35 

0.31 

22080 

B 

0 

1 

2 

1.98 

0.00 

3.60 

0.07 

22080 

C 

0 

4 

9 

0.75 

0.67 

1.80 

-0.11 

22080 

D 

0 

4 

9 

-0.50 

0.68 

0.50 

-0.36 

22081 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22081 

A 

1 

35 

78 

1.50 

0.22 

1.09 

0.36 

22081 

B 

0 

3 

7 

0.70 

0.35 

1.00 

-0.11 

22081 

C 

0 

4 

9 

0.67 

0.64 

1.50 

-0.13 

22081 

D 

0 

3 

7 

-0.44 

0.47 

0.34 

-0.34 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22082 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22082 

A 

1 

32 

71 

1.81 

0.30 

1.20 

0.40 

22082 

B 

0 

3 

7 

0.26 

1.18 

1.39 

-0.17 

22082 

C 

0 

9 

20 

0.52 

0.32 

1.12 

-0.25 

22082 

D 

0 

1 

2 

-1.84 

0.00 

0.07 

-0.28 

22083 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.00 

22083 

A 

1 

33 

77 

1.78 

0.30 

1.61 

0.27 

22083 

B 

0 

4 

9 

-0.34 

0.47 

0.41 

-0.35 

22083 

C 

0 

6 

14 

1.34 

0.54 

4.12 

-0.04 

22083 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22084 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22084 

A 

1 

26 

58 

2.44 

0.29 

0.97 

0.62 

22084 

B 

0 

3 

7 

-0.67 

0.61 

0.23 

-0.33 

22084 

C 

0 

8 

18 

0.64 

0.43 

0.89 

-0.23 

22084 

D 

0 

8 

18 

0.11 

0.52 

0.63 

-0.37 

22085 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22085 

A 

1 

33 

73 

1.65 

0.19 

0.97 

0.44 

22085 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22085 

C 

0 

10 

22 

0.20 

0.33 

0.65 

-0.50 

22085 

D 

0 

2 

4 

1.72 

0.19 

1.99 

0.07 

22086 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

0.00 

22086 

A 

1 

30 

65 

2.11 

0.24 

0.90 

0.50 

22086 

B 

0 

2 

4 

0.90 

0.45 

0.77 

-0.10 

22086 

C 

0 

8 

17 

0.37 

0.58 

1.37 

-0.37 

22086 

D 

0 

6 

13 

0.71 

0.40 

0.76 

-0.23 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22087 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

22087 

A 

1 

31 

69 

1.36 

0.24 

1.27 

0.37 

22087 

B 

0 

5 

11 

0.41 

0.48 

1.12 

-0.12 

22087 

C 

0 

3 

7 

1.82 

0.89 

6.23 

0.14 

22087 

D 

0 

6 

13 

-1.06 

0.81 

0.43 

-0.49 

22088 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.03 

22088 

A 

1 

37 

84 

2.07 

0.25 

1.18 

0.25 

22088 

B 

0 

1 

2 

0.47 

0.00 

0.45 

-0.15 

22088 

C 

0 

5 

11 

1.05 

0.39 

1.08 

-0.21 

22088 

D 

0 

1 

2 

1.91 

0.00 

1.92 

0.00 

22089 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22089 

A 

1 

34 

77 

1.73 

0.28 

1.24 

0.26 

22089 

B 

0 

2 

5 

-0.66 

2.45 

1.11 

-0.29 

22089 

C 

0 

6 

14 

0.90 

0.39 

1.27 

-0.15 

22089 

D 

0 

2 

5 

1.55 

0.36 

1.83 

0.01 

22090 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22090 

A 

1 

39 

89 

1.75 

0.24 

0.84 

0.43 

22090 

B 

0 

2 

5 

-0.06 

1.18 

0.86 

-0.21 

22090 

C 

0 

2 

5 

-1.50 

1.15 

0.20 

-0.40 

22090 

D 

0 

1 

2 

0.64 

0.00 

0.97 

-0.08 

22091 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22091 

A 

1 

33 

73 

1.92 

0.26 

1.46 

0.17 

22091 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22091 

C 

0 

9 

20 

1.54 

0.52 

4.09 

-0.08 

22091 

D 

0 

3 

7 

0.74 

0.94 

1.13 

-0.18 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22092 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22092 

A 

1 

31 

69 

2.17 

0.23 

1.05 

0.43 

22092 

B 

0 

2 

4 

1.04 

0.09 

0.69 

-0.12 

22092 

C 

0 

8 

18 

0.82 

0.34 

0.88 

-0.34 

22092 

D 

0 

4 

9 

1.08 

0.83 

2.22 

-0.16 

22093 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22093 

A 

1 

33 

73 

1.72 

0.23 

0.83 

0.47 

22093 

B 

0 

2 

4 

-0.41 

0.61 

0.33 

-0.25 

22093 

C 

0 

6 

13 

0.70 

0.38 

1.19 

-0.16 

22093 

D 

0 

4 

9 

-0.34 

0.87 

0.77 

-0.35 

22094 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22094 

A 

1 

31 

69 

1.82 

0.27 

0.90 

0.49 

22094 

B 

0 

3 

7 

-0.02 

0.49 

0.53 

-0.23 

22094 

C 

0 

9 

20 

0.60 

0.33 

1.12 

-0.23 

22094 

D 

0 

2 

4 

-1.42 

0.45 

0.11 

-0.38 

22095 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

22095 

A 

1 

31 

69 

1.51 

0.22 

0.88 

0.47 

22095 

B 

0 

4 

9 

0.67 

0.59 

1.30 

-0.08 

22095 

C 

0 

4 

9 

0.65 

0.53 

1.22 

-0.08 

22095 

D 

0 

6 

13 

-0.94 

0.77 

0.50 

-0.51 

22096 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

22096 

A 

1 

34 

74 

2.20 

0.23 

0.95 

0.51 

22096 

B 

0 

3 

7 

0.34 

0.65 

0.58 

-0.27 

22096 

C 

0 

6 

13 

0.96 

0.33 

0.89 

-0.23 

22096 

D 

0 

3 

7 

0.02 

0.33 

0.30 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22097 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22097 

A 

1 

37 

82 

1.70 

0.22 

0.87 

0.59 

22097 

B 

0 

2 

4 

-0.50 

0.67 

0.41 

-0.25 

22097 

C 

0 

4 

9 

-0.27 

0.48 

0.58 

-0.31 

22097 

D 

0 

2 

4 

-1.68 

0.72 

0.13 

-0.42 

22098 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

22098 

A 

1 

36 

78 

1.85 

0.21 

1.24 

0.47 

22098 

B 

0 

3 

7 

0.17 

0.41 

0.47 

-0.28 

22098 

C 

0 

5 

11 

0.75 

0.37 

0.90 

-0.21 

22098 

D 

0 

2 

4 

-0.22 

0.08 

0.27 

-0.29 

22099 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22099 

A 

1 

39 

85 

1.54 

0.23 

0.92 

0.48 

22099 

B 

0 

2 

4 

-0.77 

0.66 

0.34 

-0.28 

22099 

C 

0 

3 

7 

-0.10 

0.35 

0.61 

-0.23 

22099 

D 

0 

2 

4 

-0.90 

0.29 

0.26 

-0.30 

22100 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22100 

A 

1 

39 

87 

1.61 

0.21 

1.07 

0.23 

22100 

B 

0 

1 

2 

-0.31 

0.00 

0.29 

-0.20 

22100 

C 

0 

3 

7 

1.30 

0.81 

2.79 

-0.04 

22100 

D 

0 

2 

4 

0.38 

0.70 

0.72 

-0.18 

22101 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

22101 

A 

1 

31 

69 

2.44 

0.28 

0.61 

0.67 

22101 

B 

0 

4 

9 

-0.44 

0.83 

0.70 

-0.33 

22101 

C 

0 

5 

11 

-0.42 

0.47 

0.40 

-0.37 

22101 

D 

0 

5 

11 

-0.16 

0.56 

0.70 

-0.32 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22102 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22102 

A 

1 

37 

82 

1.93 

0.24 

0.78 

0.57 

22102 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22102 

C 

0 

4 

9 

-0.20 

0.22 

0.41 

-0.32 

22102 

D 

0 

4 

9 

-0.80 

0.38 

0.26 

-0.44 

22103 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

22103 

A 

1 

37 

84 

1.89 

0.22 

0.91 

0.45 

22103 

B 

0 

2 

5 

1.77 

0.27 

2.41 

0.03 

22103 

C 

0 

4 

9 

-0.70 

0.25 

0.22 

-0.50 

22103 

D 

0 

1 

2 

-0.20 

0.00 

0.32 

-0.19 

22104 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22104 

A 

1 

29 

64 

1.90 

0.28 

1.53 

0.41 

22104 

B 

0 

7 

16 

0.80 

0.40 

1.03 

-0.20 

22104 

C 

0 

8 

18 

0.65 

0.23 

0.72 

-0.27 

22104 

D 

0 

1 

2 

-0.01 

0.00 

0.31 

-0.16 

22105 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.02 

22105 

A 

1 

38 

86 

2.05 

0.24 

0.78 

0.50 

22105 

B 

0 

4 

9 

0.29 

0.56 

0.89 

-0.28 

22105 

C 

0 

1 

2 

-1.34 

0.00 

0.10 

-0.29 

22105 

D 

0 

1 

2 

-1.78 

0.00 

0.07 

-0.33 

22106 

* 

-1 

3812 

95 

1.50 

0.02 

0.00 

-0.06 

22106 

A 

1 

170 

94 

2.03 

0.11 

0.91 

0.34 

22106 

B 

0 

4 

2 

0.86 

0.12 

0.84 

-0.11 

22106 

C 

0 

3 

2 

0.18 

0.44 

0.50 

-0.16 

22106 

D 

0 

3 

2 

-1.65 

0.24 

0.07 

-0.32 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22107 

* 

-1 

1462 

37 

1.65 

0.03 

0.00 

0.07 

22107 

A 

1 

1860 

74 

1.88 

0.03 

0.98 

0.48 

22107 

B 

0 

146 

6 

0.03 

0.08 

0.64 

-0.23 

22107 

C 

0 

371 

15 

0.59 

0.05 

1.11 

-0.23 

22107 

D 

0 

153 

6 

-0.52 

0.10 

0.41 

-0.33 

22108 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

22108 

A 

1 

34 

76 

2.02 

0.25 

0.84 

0.52 

22108 

B 

0 

3 

7 

-0.27 

0.31 

0.32 

-0.31 

22108 

C 

0 

2 

4 

0.64 

1.96 

2.63 

-0.12 

22108 

D 

0 

6 

13 

0.13 

0.33 

0.53 

-0.35 

22109 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22109 

A 

1 

42 

95 

1.60 

0.19 

0.75 

0.44 

22109 

B 

0 

1 

2 

-0.10 

0.00 

0.46 

-0.18 

22109 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22109 

D 

0 

1 

2 

-2.40 

0.00 

0.05 

-0.44 

22110 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.01 

22110 

A 

1 

30 

70 

2.34 

0.29 

0.82 

0.56 

22110 

B 

0 

5 

12 

-0.45 

0.30 

0.28 

-0.44 

22110 

C 

0 

7 

16 

0.84 

0.51 

2.41 

-0.21 

22110 

D 

0 

1 

2 

-1.01 

0.00 

0.13 

-0.24 

22111 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22111 

A 

1 

42 

93 

1.49 

0.19 

0.97 

0.27 

22111 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22111 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22111 

D 

0 

3 

7 

0.15 

0.43 

0.59 

-0.27 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22112 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22112 

A 

1 

31 

69 

1.92 

0.27 

0.85 

0.51 

22112 

B 

0 

6 

13 

0.40 

0.40 

0.86 

-0.22 

22112 

C 

0 

1 

2 

-0.80 

0.00 

0.19 

-0.19 

22112 

D 

0 

7 

16 

-0.12 

0.65 

0.93 

-0.37 

22113 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

22113 

A 

1 

33 

75 

1.92 

0.24 

0.60 

0.66 

22113 

B 

0 

4 

9 

0.22 

0.27 

0.71 

-0.19 

22113 

C 

0 

2 

5 

-1.11 

0.10 

0.17 

-0.30 

22113 

D 

0 

5 

11 

-1.27 

0.38 

0.18 

-0.53 

22114 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22114 

A 

1 

33 

73 

2.22 

0.27 

0.82 

0.61 

22114 

B 

0 

3 

7 

-0.41 

0.82 

0.52 

-0.27 

22114 

C 

0 

4 

9 

-0.46 

0.65 

0.42 

-0.33 

22114 

D 

0 

5 

11 

-0.31 

0.87 

0.86 

-0.35 

22115 

* 

-1 

3782 

95 

1.51 

0.02 

0.00 

-0.01 

22115 

A 

1 

175 

83 

1.81 

0.09 

0.95 

0.42 

22115 

B 

0 

17 

8 

0.68 

0.21 

0.94 

-0.20 

22115 

C 

0 

15 

7 

0.25 

0.31 

0.86 

-0.27 

22115 

D 

0 

3 

1 

-1.47 

1.49 

0.29 

-0.27 

22116 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22116 

A 

1 

35 

78 

1.55 

0.24 

1.01 

0.36 

22116 

B 

0 

3 

7 

0.47 

0.60 

1.09 

-0.15 

22116 

C 

0 

5 

11 

0.63 

0.54 

1.37 

-0.16 

22116 

D 

0 

2 

4 

-0.67 

0.53 

0.27 

-0.29 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22117 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22117 

A 

1 

42 

93 

1.63 

0.19 

0.73 

0.51 

22117 

B 

0 

2 

4 

-1.35 

0.22 

0.13 

-0.44 

22117 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22117 

D 

0 

1 

2 

-0.81 

0.00 

0.22 

-0.25 

22118 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22118 

A 

1 

40 

89 

1.50 

0.24 

0.78 

0.43 

22118 

B 

0 

1 

2 

0.02 

0.00 

0.73 

-0.11 

22118 

C 

0 

3 

7 

-0.47 

1.07 

1.26 

-0.28 

22118 

D 

0 

1 

2 

-2.40 

0.00 

0.06 

-0.33 

22119 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

22119 

A 

1 

40 

87 

1.35 

0.26 

1.07 

0.42 

22119 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22119 

C 

0 

2 

4 

-0.74 

0.32 

0.40 

-0.23 

22119 

D 

0 

4 

9 

-0.70 

0.50 

0.57 

-0.33 

22120 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22120 

A 

1 

39 

87 

1.89 

0.19 

0.79 

0.52 

22120 

B 

0 

1 

2 

-0.39 

0.00 

0.23 

-0.23 

22120 

C 

0 

3 

7 

-0.11 

0.74 

0.52 

-0.35 

22120 

D 

0 

2 

4 

-0.04 

0.51 

0.38 

-0.27 

22121 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22121 

A 

1 

38 

84 

1.65 

0.23 

0.79 

0.54 

22121 

B 

0 

4 

9 

-0.72 

0.20 

0.30 

-0.41 

22121 

C 

0 

2 

4 

-0.35 

1.07 

0.67 

-0.23 

22121 

D 

0 

1 

2 

-1.07 

0.00 

0.20 

-0.23 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22122 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

22122 

A 

1 

34 

77 

1.52 

0.26 

0.94 

0.51 

22122 

B 

0 

2 

5 

0.86 

0.06 

1.45 

-0.03 

22122 

C 

0 

3 

7 

-0.38 

0.19 

0.43 

-0.23 

22122 

D 

0 

5 

11 

-1.13 

0.74 

0.71 

-0.47 

22123 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

22123 

A 

1 

37 

80 

1.59 

0.24 

1.47 

0.35 

22123 

B 

0 

3 

7 

-0.05 

0.48 

0.57 

-0.24 

22123 

C 

0 

4 

9 

0.68 

0.60 

1.51 

-0.13 

22123 

D 

0 

2 

4 

-0.11 

1.77 

1.29 

-0.20 

22124 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22124 

A 

1 

41 

91 

1.67 

0.25 

0.95 

0.34 

22124 

B 

0 

1 

2 

-2.00 

0.00 

0.07 

-0.32 

22124 

C 

0 

1 

2 

0.23 

0.00 

0.68 

-0.12 

22124 

D 

0 

2 

4 

0.33 

0.14 

0.76 

-0.15 

22125 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

22125 

A 

1 

42 

95 

1.37 

0.22 

0.61 

0.48 

22125 

B 

0 

1 

2 

0.11 

0.00 

1.32 

-0.10 

22125 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22125 

D 

0 

1 

2 

-5.44 

0.00 

0.01 

-0.58 

22126 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.02 

22126 

A 

1 

36 

82 

2.02 

0.24 

0.94 

0.39 

22126 

B 

0 

4 

9 

0.84 

0.49 

1.12 

-0.18 

22126 

C 

0 

2 

5 

0.87 

2.28 

4.31 

-0.12 

22126 

D 

0 

2 

5 

-0.80 

0.46 

0.18 

-0.35 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22127 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

22127 

A 

1 

44 

96 

1.57 

0.22 

0.78 

0.43 

22127 

B 

0 

1 

2 

-1.78 

0.00 

0.11 

-0.30 

22127 

C 

0 

1 

2 

-1.70 

0.00 

0.12 

-0.29 

22127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22128 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.04 

22128 

A 

1 

28 

64 

1.55 

0.25 

1.21 

0.58 

22128 

B 

0 

5 

11 

0.04 

0.28 

0.63 

-0.21 

22128 

C 

0 

3 

7 

0.11 

0.98 

1.50 

-0.15 

22128 

D 

0 

8 

18 

-0.47 

0.32 

0.46 

-0.45 

22129 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22129 

A 

1 

38 

84 

1.48 

0.21 

0.98 

0.42 

22129 

B 

0 

1 

2 

0.32 

0.00 

0.66 

-0.11 

22129 

C 

0 

3 

7 

-0.10 

0.54 

0.55 

-0.27 

22129 

D 

0 

3 

7 

-0.15 

0.08 

0.42 

-0.28 

22130 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.03 

22130 

A 

1 

37 

84 

2.29 

0.27 

0.83 

0.50 

22130 

B 

0 

1 

2 

0.13 

0.00 

0.46 

-0.15 

22130 

C 

0 

4 

9 

-0.23 

0.44 

0.43 

-0.38 

22130 

D 

0 

2 

5 

-0.18 

0.61 

0.41 

-0.26 

22131 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

22131 

A 

1 

41 

93 

1.39 

0.21 

0.89 

0.32 

22131 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22131 

C 

0 

1 

2 

0.79 

0.00 

1.21 

-0.05 

22131 

D 

0 

2 

5 

-0.91 

0.59 

0.26 

-0.34 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22132 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22132 

A 

1 

34 

74 

1.70 

0.22 

0.91 

0.50 

22132 

B 

0 

5 

11 

-0.50 

0.23 

0.29 

-0.46 

22132 

C 

0 

4 

9 

0.72 

0.61 

1.52 

-0.13 

22132 

D 

0 

3 

7 

0.43 

0.25 

0.71 

-0.17 

22133 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

22133 

A 

1 

38 

86 

1.87 

0.26 

0.99 

0.39 

22133 

B 

0 

3 

7 

0.45 

0.10 

0.72 

-0.20 

22133 

C 

0 

2 

5 

-0.01 

0.61 

0.54 

-0.22 

22133 

D 

0 

1 

2 

-1.06 

0.00 

0.16 

-0.25 

22134 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

22134 

A 

1 

37 

80 

1.92 

0.25 

1.04 

0.37 

22134 

B 

0 

1 

2 

-0.12 

0.00 

0.33 

-0.18 

22134 

C 

0 

5 

11 

0.90 

0.35 

1.14 

-0.18 

22134 

D 

0 

3 

7 

0.11 

0.59 

0.53 

-0.27 

22135 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22135 

A 

1 

40 

89 

1.56 

0.18 

0.91 

0.32 

22135 

B 

0 

2 

4 

1.99 

0.79 

4.17 

0.10 

22135 

C 

0 

1 

2 

-0.70 

0.00 

0.21 

-0.25 

22135 

D 

0 

2 

4 

-0.96 

1.12 

0.28 

-0.40 

22136 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22136 

A 

1 

41 

91 

1.74 

0.20 

1.19 

0.17 

22136 

B 

0 

1 

2 

2.39 

0.00 

3.66 

0.09 

22136 

C 

0 

1 

2 

1.17 

0.00 

1.08 

-0.06 

22136 

D 

0 

2 

4 

0.26 

0.67 

0.54 

-0.25 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22137 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22137 

A 

1 

38 

84 

1.60 

0.22 

0.93 

0.40 

22137 

B 

0 

2 

4 

0.31 

0.45 

0.69 

-0.16 

22137 

C 

0 

4 

9 

0.41 

0.40 

0.91 

-0.21 

22137 

D 

0 

1 

2 

-2.09 

0.00 

0.06 

-0.37 

22138 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22138 

A 

1 

39 

87 

2.04 

0.21 

0.95 

0.44 

22138 

B 

0 

2 

4 

0.38 

0.44 

0.48 

-0.23 

22138 

C 

0 

2 

4 

0.43 

0.55 

0.53 

-0.22 

22138 

D 

0 

2 

4 

0.09 

0.50 

0.37 

-0.27 

22139 

* 

-1 

3943 

99 

1.51 

0.02 

0.00 

-0.01 

22139 

A 

1 

42 

86 

1.88 

0.19 

0.93 

0.48 

22139 

B 

0 

1 

2 

1.13 

0.00 

1.06 

-0.05 

22139 

C 

0 

4 

8 

-0.02 

0.28 

0.38 

-0.37 

22139 

D 

0 

2 

4 

-0.28 

0.63 

0.31 

-0.30 

22140 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22140 

A 

1 

40 

89 

1.63 

0.25 

1.12 

0.25 

22140 

B 

0 

1 

2 

-0.39 

0.00 

0.33 

-0.19 

22140 

C 

0 

3 

7 

0.74 

0.52 

1.34 

-0.13 

22140 

D 

0 

1 

2 

0.38 

0.00 

0.72 

-0.11 

22141 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

22141 

A 

1 

36 

78 

1.88 

0.25 

0.82 

0.56 

22141 

B 

0 

1 

2 

-1.34 

0.00 

0.13 

-0.22 

22141 

C 

0 

4 

9 

0.52 

0.51 

1.23 

-0.14 

22141 

D 

0 

5 

11 

-1.25 

0.68 

0.25 

-0.51 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22142 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22142 

A 

1 

32 

73 

2.06 

0.26 

0.99 

0.52 

22142 

B 

0 

4 

9 

0.61 

0.47 

0.89 

-0.14 

22142 

C 

0 

5 

11 

0.87 

0.68 

2.38 

-0.11 

22142 

D 

0 

3 

7 

-2.75 

0.89 

0.06 

-0.61 

22143 

* 

-1 

3945 

99 

1.51 

0.02 

0.00 

0.00 

22143 

A 

1 

39 

83 

1.85 

0.25 

0.88 

0.38 

22143 

B 

0 

1 

2 

-0.97 

0.00 

0.18 

-0.22 

22143 

C 

0 

3 

6 

0.92 

1.02 

2.35 

-0.10 

22143 

D 

0 

4 

9 

-0.17 

1.17 

2.17 

-0.31 

22144 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22144 

A 

1 

33 

73 

2.03 

0.30 

1.73 

0.28 

22144 

B 

0 

6 

13 

1.04 

0.52 

1.58 

-0.18 

22144 

C 

0 

3 

7 

1.09 

0.42 

1.03 

-0.11 

22144 

D 

0 

3 

7 

0.94 

0.45 

0.91 

-0.14 

22145 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.00 

22145 

A 

1 

35 

81 

1.79 

0.27 

1.07 

0.40 

22145 

B 

0 

1 

2 

1.67 

0.00 

2.66 

0.02 

22145 

C 

0 

5 

12 

0.02 

0.73 

1.21 

-0.31 

22145 

D 

0 

2 

5 

-0.83 

1.55 

0.54 

-0.30 

22146 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22146 

A 

1 

38 

84 

1.67 

0.25 

0.94 

0.40 

22146 

B 

0 

2 

4 

1.36 

0.34 

2.10 

-0.01 

22146 

C 

0 

1 

2 

0.16 

0.00 

0.60 

-0.12 

22146 

D 

0 

4 

9 

-0.85 

0.15 

0.23 

-0.45 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22147 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

22147 

A 

1 

33 

75 

1.71 

0.21 

0.80 

0.48 

22147 

B 

0 

4 

9 

-0.23 

0.16 

0.32 

-0.38 

22147 

C 

0 

4 

9 

0.50 

0.67 

1.22 

-0.20 

22147 

D 

0 

3 

7 

0.51 

0.89 

1.31 

-0.17 

22148 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

22148 

A 

1 

35 

78 

1.45 

0.28 

0.89 

0.48 

22148 

B 

0 

1 

2 

-1.02 

0.00 

0.27 

-0.17 

22148 

C 

0 

3 

7 

0.63 

0.65 

2.00 

-0.06 

22148 

D 

0 

6 

13 

-1.14 

0.37 

0.31 

-0.48 

22149 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22149 

A 

1 

36 

80 

1.67 

0.18 

0.80 

0.60 

22149 

B 

0 

1 

2 

1.05 

0.00 

1.25 

-0.03 

22149 

C 

0 

6 

13 

-0.42 

0.44 

0.46 

-0.50 

22149 

D 

0 

2 

4 

-0.62 

0.35 

0.25 

-0.31 

22150 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22150 

A 

1 

38 

84 

1.29 

0.22 

1.21 

0.31 

22150 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22150 

C 

0 

2 

4 

-0.33 

0.87 

0.57 

-0.23 

22150 

D 

0 

5 

11 

0.33 

0.41 

1.11 

-0.21 

22151 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22151 

A 

1 

34 

74 

1.64 

0.18 

0.92 

0.49 

22151 

B 

0 

3 

7 

1.04 

0.35 

1.16 

-0.05 

22151 

C 

0 

5 

11 

0.05 

0.78 

1.45 

-0.35 

22151 

D 

0 

4 

9 

-0.02 

0.26 

0.40 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22152 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22152 

A 

1 

38 

84 

1.59 

0.22 

0.87 

0.48 

22152 

B 

0 

2 

4 

-0.95 

0.61 

0.23 

-0.34 

22152 

C 

0 

2 

4 

0.35 

0.58 

0.84 

-0.14 

22152 

D 

0 

3 

7 

-0.30 

0.18 

0.39 

-0.30 

22153 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22153 

A 

1 

41 

91 

1.86 

0.19 

0.90 

0.50 

22153 

B 

0 

1 

2 

-0.31 

0.00 

0.28 

-0.22 

22153 

C 

0 

2 

4 

-0.78 

0.56 

0.21 

-0.39 

22153 

D 

0 

1 

2 

-0.20 

0.00 

0.32 

-0.21 

22154 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

22154 

A 

1 

33 

72 

2.24 

0.28 

0.91 

0.53 

22154 

B 

0 

3 

7 

1.74 

0.71 

3.62 

0.01 

22154 

C 

0 

3 

7 

-0.06 

0.30 

0.38 

-0.25 

22154 

D 

0 

7 

15 

-0.48 

0.44 

0.37 

-0.50 

22155 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22155 

A 

1 

31 

69 

1.51 

0.24 

1.21 

0.33 

22155 

B 

0 

4 

9 

0.05 

0.35 

0.53 

-0.28 

22155 

C 

0 

5 

11 

1.21 

0.42 

1.99 

0.00 

22155 

D 

0 

5 

11 

0.34 

0.52 

1.18 

-0.24 

22156 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22156 

A 

1 

28 

62 

1.91 

0.19 

0.75 

0.68 

22156 

B 

0 

5 

11 

-0.06 

0.42 

0.42 

-0.39 

22156 

C 

0 

5 

11 

0.37 

0.43 

0.69 

-0.27 

22156 

D 

0 

7 

16 

0.32 

0.16 

0.49 

-0.34 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22157 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22157 

A 

1 

40 

89 

1.78 

0.20 

0.55 

0.64 

22157 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22157 

C 

0 

1 

2 

-0.77 

0.00 

0.27 

-0.19 

22157 

D 

0 

4 

9 

-1.89 

0.94 

0.24 

-0.61 

22158 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22158 

A 

1 

36 

80 

2.02 

0.25 

1.08 

0.50 

22158 

B 

0 

3 

7 

-0.11 

0.71 

0.61 

-0.29 

22158 

C 

0 

4 

9 

-0.19 

0.12 

0.34 

-0.35 

22158 

D 

0 

2 

4 

0.60 

0.24 

0.75 

-0.14 

22159 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.03 

22159 

A 

1 

42 

95 

1.96 

0.17 

0.89 

0.32 

22159 

B 

0 

1 

2 

-0.79 

0.00 

0.12 

-0.35 

22159 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22159 

D 

0 

1 

2 

1.10 

0.00 

0.80 

-0.10 

22160 

* 

-1 

3950 

99 

1.52 

0.02 

0.00 

0.02 

22160 

A 

1 

37 

88 

1.55 

0.20 

0.72 

0.52 

22160 

B 

0 

1 

2 

0.28 

0.00 

0.72 

-0.10 

22160 

C 

0 

2 

5 

-0.13 

1.52 

1.13 

-0.20 

22160 

D 

0 

2 

5 

-2.29 

2.00 

0.21 

-0.52 

22161 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.00 

22161 

A 

1 

34 

79 

1.81 

0.27 

1.25 

0.42 

22161 

B 

0 

1 

2 

1.02 

0.00 

1.19 

-0.04 

22161 

C 

0 

5 

12 

-0.14 

0.38 

0.50 

-0.37 

22161 

D 

0 

3 

7 

0.46 

0.32 

0.76 

-0.18 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22162 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

22162 

A 

1 

41 

89 

1.95 

0.19 

0.70 

0.55 

22162 

B 

0 

2 

4 

-0.95 

0.75 

0.19 

-0.39 

22162 

C 

0 

1 

2 

-1.50 

0.00 

0.09 

-0.33 

22162 

D 

0 

2 

4 

0.32 

0.88 

0.75 

-0.20 

22163 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22163 

A 

1 

36 

80 

1.57 

0.26 

2.31 

0.47 

22163 

B 

0 

3 

7 

-0.59 

0.75 

0.59 

-0.26 

22163 

C 

0 

2 

4 

-0.41 

1.33 

0.79 

-0.19 

22163 

D 

0 

4 

9 

-0.48 

1.20 

1.00 

-0.29 

22164 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

22164 

A 

1 

40 

89 

2.25 

0.24 

0.90 

0.47 

22164 

B 

0 

1 

2 

-0.64 

0.00 

0.17 

-0.23 

22164 

C 

0 

2 

4 

0.94 

0.75 

1.07 

-0.13 

22164 

D 

0 

2 

4 

-1.42 

2.35 

0.41 

-0.42 

22165 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

22165 

A 

1 

23 

52 

1.93 

0.26 

1.14 

0.48 

22165 

B 

0 

6 

14 

0.74 

0.29 

0.71 

-0.20 

22165 

C 

0 

9 

20 

0.95 

0.46 

1.49 

-0.16 

22165 

D 

0 

6 

14 

0.40 

0.27 

0.52 

-0.30 

22166 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

22166 

A 

1 

27 

59 

1.94 

0.22 

0.59 

0.71 

22166 

B 

0 

3 

7 

-0.60 

0.42 

0.26 

-0.32 

22166 

C 

0 

10 

22 

0.10 

0.24 

0.56 

-0.38 

22166 

D 

0 

6 

13 

-0.07 

0.38 

0.55 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22167 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22167 

A 

1 

34 

76 

1.94 

0.28 

0.76 

0.55 

22167 

B 

0 

4 

9 

-0.04 

0.51 

0.75 

-0.22 

22167 

C 

0 

3 

7 

0.28 

1.57 

5.59 

-0.15 

22167 

D 

0 

4 

9 

-1.62 

0.53 

0.17 

-0.48 

22168 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

22168 

A 

1 

37 

80 

1.75 

0.19 

0.79 

0.53 

22168 

B 

0 

2 

4 

-0.14 

0.11 

0.34 

-0.25 

22168 

C 

0 

2 

4 

1.01 

0.92 

1.54 

-0.07 

22168 

D 

0 

5 

11 

-0.30 

0.37 

0.37 

-0.46 

22169 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

22169 

A 

1 

16 

36 

2.26 

0.38 

1.06 

0.51 

22169 

B 

0 

2 

5 

0.40 

1.86 

1.27 

-0.10 

22169 

C 

0 

10 

23 

0.38 

0.53 

1.12 

-0.26 

22169 

D 

0 

16 

36 

0.63 

0.29 

0.88 

-0.24 

22170 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22170 

A 

1 

32 

71 

1.78 

0.24 

0.84 

0.56 

22170 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22170 

C 

0 

4 

9 

0.14 

0.31 

0.58 

-0.19 

22170 

D 

0 

9 

20 

-0.52 

0.68 

0.56 

-0.50 

22171 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22171 

A 

1 

26 

58 

1.98 

0.26 

1.01 

0.47 

22171 

B 

0 

5 

11 

0.99 

0.59 

1.70 

-0.09 

22171 

C 

0 

6 

13 

0.32 

0.59 

0.88 

-0.28 

22171 

D 

0 

8 

18 

0.50 

0.51 

0.92 

-0.28 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22172 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

22172 

A 

1 

36 

78 

2.07 

0.27 

0.63 

0.61 

22172 

B 

0 

2 

4 

-0.06 

0.01 

0.48 

-0.18 

22172 

C 

0 

3 

7 

-0.93 

0.56 

0.26 

-0.35 

22172 

D 

0 

5 

11 

-0.63 

0.40 

0.35 

-0.41 

22173 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22173 

A 

1 

40 

89 

1.67 

0.22 

0.91 

0.34 

22173 

B 

0 

2 

4 

0.45 

1.69 

2.07 

-0.15 

22173 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22173 

D 

0 

3 

7 

-0.21 

0.99 

0.71 

-0.31 

22174 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22174 

A 

1 

30 

65 

1.88 

0.20 

0.69 

0.63 

22174 

B 

0 

4 

9 

0.47 

0.31 

0.67 

-0.19 

22174 

C 

0 

3 

7 

-0.01 

0.58 

0.47 

-0.25 

22174 

D 

0 

9 

20 

0.01 

0.36 

0.52 

-0.47 

22175 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

22175 

A 

1 

41 

91 

2.07 

0.23 

0.87 

0.41 

22175 

B 

0 

2 

4 

-0.19 

0.46 

0.36 

-0.29 

22175 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22175 

D 

0 

2 

4 

-0.14 

1.43 

0.75 

-0.28 

22176 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

22176 

A 

1 

24 

52 

2.61 

0.31 

0.62 

0.64 

22176 

B 

0 

5 

11 

0.29 

0.39 

0.52 

-0.25 

22176 

C 

0 

9 

20 

0.69 

0.39 

1.37 

-0.24 

22176 

D 

0 

8 

17 

0.01 

0.54 

0.81 

-0.40 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22177 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.00 

22177 

A 

1 

37 

86 

1.70 

0.30 

1.32 

0.22 

22177 

B 

0 

3 

7 

0.66 

0.41 

1.28 

-0.14 

22177 

C 

0 

1 

2 

-0.56 

0.00 

0.32 

-0.19 

22177 

D 

0 

2 

5 

1.00 

0.96 

2.30 

-0.07 

22178 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22178 

A 

1 

37 

82 

1.84 

0.28 

0.96 

0.42 

22178 

B 

0 

3 

7 

-0.58 

0.08 

0.27 

-0.32 

22178 

C 

0 

3 

7 

0.84 

0.71 

1.60 

-0.10 

22178 

D 

0 

2 

4 

-0.74 

0.65 

0.28 

-0.28 

22179 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22179 

A 

1 

35 

78 

2.21 

0.23 

0.76 

0.52 

22179 

B 

0 

2 

4 

0.11 

1.06 

0.53 

-0.24 

22179 

C 

0 

3 

7 

-0.42 

0.35 

0.22 

-0.39 

22179 

D 

0 

5 

11 

0.86 

0.55 

1.15 

-0.22 

22180 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

22180 

A 

1 

29 

63 

2.11 

0.30 

1.76 

0.40 

22180 

B 

0 

2 

4 

1.55 

0.60 

1.59 

-0.01 

22180 

C 

0 

12 

26 

0.85 

0.25 

0.94 

-0.33 

22180 

D 

0 

3 

7 

0.57 

0.56 

0.65 

-0.20 

22181 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22181 

A 

1 

22 

49 

2.20 

0.29 

0.96 

0.47 

22181 

B 

0 

5 

11 

0.33 

0.41 

0.47 

-0.31 

22181 

C 

0 

14 

31 

1.03 

0.34 

1.17 

-0.24 

22181 

D 

0 

4 

9 

1.14 

0.41 

0.95 

-0.09 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22182 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22182 

A 

1 

22 

49 

2.06 

0.21 

0.66 

0.67 

22182 

B 

0 

6 

13 

1.02 

0.37 

1.08 

-0.06 

22182 

C 

0 

12 

27 

0.32 

0.24 

0.54 

-0.43 

22182 

D 

0 

5 

11 

-0.19 

0.40 

0.32 

-0.39 

22183 

* 

-1 

1471 

37 

1.65 

0.03 

0.00 

0.07 

22183 

A 

1 

1723 

68 

1.97 

0.03 

0.99 

0.51 

22183 

B 

0 

174 

7 

0.17 

0.08 

0.81 

-0.23 

22183 

C 

0 

208 

8 

0.49 

0.08 

0.99 

-0.19 

22183 

D 

0 

416 

17 

0.26 

0.06 

0.83 

-0.34 

22184 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22184 

A 

1 

26 

59 

1.97 

0.25 

1.44 

0.40 

22184 

B 

0 

2 

5 

0.28 

1.45 

0.75 

-0.19 

22184 

C 

0 

8 

18 

0.84 

0.57 

1.19 

-0.22 

22184 

D 

0 

8 

18 

0.95 

0.36 

0.97 

-0.19 

22185 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22185 

A 

1 

39 

87 

1.28 

0.18 

0.89 

0.37 

22185 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22185 

C 

0 

1 

2 

2.71 

0.00 

9.12 

0.19 

22185 

D 

0 

5 

11 

-0.70 

0.67 

0.98 

-0.49 

22186 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22186 

A 

1 

33 

73 

2.18 

0.22 

0.96 

0.54 

22186 

B 

0 

2 

4 

-0.10 

0.17 

0.26 

-0.25 

22186 

C 

0 

4 

9 

0.40 

0.98 

1.28 

-0.26 

22186 

D 

0 

6 

13 

0.38 

0.66 

0.91 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22187 

* 

-1 

3787 

95 

1.51 

0.02 

0.00 

0.00 

22187 

A 

1 

143 

70 

1.83 

0.09 

1.00 

0.39 

22187 

B 

0 

20 

10 

0.58 

0.21 

0.74 

-0.27 

22187 

C 

0 

39 

19 

1.07 

0.13 

1.08 

-0.19 

22187 

D 

0 

3 

1 

-0.26 

0.85 

0.43 

-0.19 

22188 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22188 

A 

1 

27 

60 

2.33 

0.32 

1.18 

0.44 

22188 

B 

0 

3 

7 

1.15 

0.80 

1.23 

-0.10 

22188 

C 

0 

9 

20 

0.97 

0.40 

1.19 

-0.24 

22188 

D 

0 

6 

13 

0.63 

0.39 

0.65 

-0.27 

22189 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22189 

A 

1 

37 

82 

1.69 

0.23 

0.97 

0.39 

22189 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22189 

C 

0 

3 

7 

0.60 

0.80 

1.41 

-0.15 

22189 

D 

0 

5 

11 

-0.10 

0.71 

0.90 

-0.36 

22190 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.03 

22190 

A 

1 

23 

52 

2.92 

0.29 

0.60 

0.64 

22190 

B 

0 

3 

7 

1.44 

0.91 

1.29 

-0.07 

22190 

C 

0 

11 

25 

0.71 

0.39 

0.63 

-0.39 

22190 

D 

0 

7 

16 

0.44 

0.53 

0.52 

-0.36 

22191 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22191 

A 

1 

27 

60 

2.52 

0.30 

2.01 

0.56 

22191 

B 

0 

5 

11 

1.44 

0.45 

1.50 

-0.06 

22191 

C 

0 

4 

9 

0.39 

0.51 

0.50 

-0.24 

22191 

D 

0 

9 

20 

0.12 

0.47 

0.64 

-0.46 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22192 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22192 

A 

1 

28 

62 

1.84 

0.25 

1.14 

0.43 

22192 

B 

0 

6 

13 

0.60 

0.58 

2.16 

-0.21 

22192 

C 

0 

4 

9 

1.22 

0.81 

2.46 

-0.03 

22192 

D 

0 

7 

16 

0.14 

0.39 

0.59 

-0.36 

22193 

* 

-1 

3936 

99 

1.52 

0.02 

0.00 

0.01 

22193 

A 

1 

32 

57 

1.91 

0.23 

1.02 

0.51 

22193 

B 

0 

1 

2 

0.76 

0.00 

0.71 

-0.06 

22193 

C 

0 

15 

27 

0.68 

0.24 

0.91 

-0.30 

22193 

D 

0 

8 

14 

0.35 

0.29 

0.65 

-0.31 

22194 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22194 

A 

1 

31 

70 

1.93 

0.26 

1.16 

0.41 

22194 

B 

0 

6 

14 

0.79 

0.58 

1.53 

-0.20 

22194 

C 

0 

4 

9 

0.41 

0.40 

0.62 

-0.24 

22194 

D 

0 

3 

7 

0.58 

0.81 

1.18 

-0.18 

22195 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22195 

A 

1 

34 

76 

1.88 

0.23 

0.96 

0.48 

22195 

B 

0 

2 

4 

0.74 

0.23 

0.78 

-0.12 

22195 

C 

0 

4 

9 

0.64 

0.58 

1.26 

-0.20 

22195 

D 

0 

5 

11 

0.00 

0.22 

0.40 

-0.39 

22196 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22196 

A 

1 

37 

82 

1.94 

0.24 

0.82 

0.45 

22196 

B 

0 

1 

2 

-0.80 

0.00 

0.17 

-0.24 

22196 

C 

0 

1 

2 

0.76 

0.00 

0.83 

-0.08 

22196 

D 

0 

6 

13 

0.17 

0.40 

0.71 

-0.37 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22197 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22197 

A 

1 

37 

82 

1.81 

0.26 

1.10 

0.36 

22197 

B 

0 

3 

7 

0.40 

0.92 

1.50 

-0.18 

22197 

C 

0 

2 

4 

0.25 

1.27 

1.06 

-0.17 

22197 

D 

0 

3 

7 

0.13 

1.03 

1.22 

-0.23 

22198 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

0.00 

22198 

A 

1 

25 

57 

2.43 

0.27 

0.79 

0.58 

22198 

B 

0 

3 

7 

1.17 

0.38 

0.93 

-0.06 

22198 

C 

0 

9 

20 

0.54 

0.42 

0.90 

-0.30 

22198 

D 

0 

7 

16 

-0.02 

0.78 

0.60 

-0.40 

22199 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22199 

A 

1 

39 

87 

1.70 

0.24 

1.01 

0.31 

22199 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22199 

C 

0 

3 

7 

0.64 

0.91 

1.63 

-0.15 

22199 

D 

0 

3 

7 

-0.03 

0.70 

0.64 

-0.27 

22200 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22200 

A 

1 

36 

80 

1.52 

0.23 

0.95 

0.40 

22200 

B 

0 

4 

9 

0.39 

0.44 

1.02 

-0.18 

22200 

C 

0 

1 

2 

2.18 

0.00 

4.63 

0.10 

22200 

D 

0 

4 

9 

-0.80 

0.46 

0.30 

-0.43 

22201 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

22201 

A 

1 

37 

84 

1.97 

0.26 

1.13 

0.38 

22201 

B 

0 

1 

2 

-0.76 

0.00 

0.20 

-0.22 

22201 

C 

0 

1 

2 

1.69 

0.00 

2.36 

0.00 

22201 

D 

0 

5 

11 

0.10 

0.76 

1.03 

-0.34 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22202 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22202 

A 

1 

21 

47 

2.18 

0.32 

1.13 

0.44 

22202 

B 

0 

12 

27 

0.62 

0.48 

2.13 

-0.32 

22202 

C 

0 

5 

11 

1.09 

0.57 

1.50 

-0.08 

22202 

D 

0 

7 

16 

0.90 

0.42 

0.98 

-0.15 

22203 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22203 

A 

1 

22 

49 

1.72 

0.27 

1.45 

0.33 

22203 

B 

0 

10 

22 

1.13 

0.30 

1.29 

-0.08 

22203 

C 

0 

5 

11 

1.12 

0.62 

1.89 

-0.05 

22203 

D 

0 

8 

18 

0.51 

0.41 

0.80 

-0.30 

22204 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22204 

A 

1 

32 

71 

1.58 

0.21 

0.89 

0.52 

22204 

B 

0 

5 

11 

0.14 

0.42 

0.73 

-0.28 

22204 

C 

0 

1 

2 

-0.08 

0.00 

0.39 

-0.14 

22204 

D 

0 

7 

16 

0.13 

0.44 

0.75 

-0.34 

22205 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22205 

A 

1 

25 

56 

2.61 

0.31 

1.00 

0.56 

22205 

B 

0 

1 

2 

-0.28 

0.00 

0.19 

-0.18 

22205 

C 

0 

13 

29 

0.69 

0.26 

0.73 

-0.40 

22205 

D 

0 

6 

13 

0.89 

0.81 

1.65 

-0.20 

22206 

* 

-1 

3950 

99 

1.52 

0.02 

0.00 

0.01 

22206 

A 

1 

23 

55 

2.20 

0.32 

1.09 

0.56 

22206 

B 

0 

1 

2 

0.97 

0.00 

0.86 

-0.04 

22206 

C 

0 

15 

36 

0.61 

0.23 

0.82 

-0.39 

22206 

D 

0 

3 

7 

-0.46 

0.41 

0.24 

-0.34 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22207 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22207 

A 

1 

27 

60 

2.20 

0.24 

0.71 

0.66 

22207 

B 

0 

4 

9 

-0.22 

0.45 

0.32 

-0.36 

22207 

C 

0 

7 

16 

0.15 

0.30 

0.46 

-0.39 

22207 

D 

0 

7 

16 

0.67 

0.29 

0.75 

-0.23 

22208 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22208 

A 

1 

31 

69 

1.92 

0.25 

1.06 

0.44 

22208 

B 

0 

1 

2 

1.19 

0.00 

1.12 

-0.03 

22208 

C 

0 

3 

7 

0.75 

0.99 

1.46 

-0.13 

22208 

D 

0 

10 

22 

0.37 

0.42 

0.96 

-0.40 

22209 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

22209 

A 

1 

33 

77 

1.81 

0.20 

1.06 

0.52 

22209 

B 

0 

1 

2 

-1.04 

0.00 

0.12 

-0.29 

22209 

C 

0 

4 

9 

1.12 

0.27 

1.13 

-0.08 

22209 

D 

0 

5 

12 

-0.24 

0.54 

0.42 

-0.47 

22210 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22210 

A 

1 

17 

38 

2.04 

0.30 

1.03 

0.44 

22210 

B 

0 

3 

7 

-0.10 

0.38 

0.26 

-0.33 

22210 

C 

0 

17 

38 

1.09 

0.25 

1.26 

-0.17 

22210 

D 

0 

8 

18 

1.03 

0.27 

0.85 

-0.13 

22211 

* 

-1 

3945 

99 

1.51 

0.02 

0.00 

-0.01 

22211 

A 

1 

21 

45 

2.64 

0.32 

1.15 

0.57 

22211 

B 

0 

1 

2 

0.00 

0.00 

0.20 

-0.17 

22211 

C 

0 

17 

36 

1.28 

0.25 

1.02 

-0.21 

22211 

D 

0 

8 

17 

0.32 

0.31 

0.37 

-0.42 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22212 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22212 

A 

1 

27 

60 

2.31 

0.25 

0.72 

0.60 

22212 

B 

0 

4 

9 

0.78 

0.32 

0.69 

-0.19 

22212 

C 

0 

9 

20 

0.70 

0.23 

0.66 

-0.33 

22212 

D 

0 

5 

11 

0.24 

0.53 

0.57 

-0.35 

22213 

* 

-1 

3945 

99 

1.52 

0.02 

0.00 

0.02 

22213 

A 

1 

30 

64 

1.87 

0.26 

0.92 

0.59 

22213 

B 

0 

3 

6 

0.05 

0.51 

0.58 

-0.19 

22213 

C 

0 

6 

13 

-0.08 

0.42 

0.60 

-0.31 

22213 

D 

0 

8 

17 

-0.04 

0.36 

0.65 

-0.36 

22214 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

22214 

A 

1 

25 

57 

2.10 

0.26 

1.27 

0.36 

22214 

B 

0 

3 

7 

1.58 

0.19 

1.08 

-0.03 

22214 

C 

0 

12 

27 

1.32 

0.30 

1.16 

-0.20 

22214 

D 

0 

4 

9 

0.60 

0.30 

0.44 

-0.29 

22215 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

22215 

A 

1 

29 

67 

1.97 

0.27 

0.85 

0.48 

22215 

B 

0 

6 

14 

0.28 

0.36 

0.70 

-0.30 

22215 

C 

0 

1 

2 

-0.03 

0.00 

0.37 

-0.14 

22215 

D 

0 

7 

16 

0.44 

0.68 

1.89 

-0.28 

22216 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22216 

A 

1 

28 

62 

2.13 

0.23 

0.77 

0.57 

22216 

B 

0 

6 

13 

0.98 

0.40 

1.05 

-0.17 

22216 

C 

0 

7 

16 

0.66 

0.31 

0.74 

-0.29 

22216 

D 

0 

4 

9 

-0.11 

0.29 

0.27 

-0.40 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22217 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22217 

A 

1 

26 

57 

1.99 

0.23 

0.79 

0.57 

22217 

B 

0 

3 

7 

0.52 

0.78 

0.98 

-0.15 

22217 

C 

0 

5 

11 

0.71 

0.34 

0.79 

-0.15 

22217 

D 

0 

12 

26 

0.27 

0.37 

0.78 

-0.45 

22218 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22218 

A 

1 

20 

43 

2.18 

0.31 

1.17 

0.53 

22218 

B 

0 

6 

13 

1.45 

0.42 

2.08 

0.05 

22218 

C 

0 

11 

24 

0.47 

0.34 

0.71 

-0.31 

22218 

D 

0 

9 

20 

0.15 

0.37 

0.51 

-0.38 

22219 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

22219 

A 

1 

19 

41 

2.53 

0.32 

0.93 

0.57 

22219 

B 

0 

5 

11 

1.00 

0.61 

1.01 

-0.08 

22219 

C 

0 

9 

20 

1.29 

0.19 

0.88 

-0.03 

22219 

D 

0 

13 

28 

-0.03 

0.45 

0.44 

-0.53 

22220 

* 

-1 

3938 

99 

1.52 

0.02 

0.00 

0.03 

22220 

A 

1 

17 

31 

2.28 

0.39 

1.42 

0.43 

22220 

B 

0 

3 

6 

-0.62 

1.70 

0.61 

-0.26 

22220 

C 

0 

14 

26 

0.52 

0.38 

1.05 

-0.24 

22220 

D 

0 

20 

37 

1.03 

0.29 

1.16 

-0.08 

22221 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22221 

A 

1 

32 

71 

1.42 

0.23 

1.09 

0.27 

22221 

B 

0 

5 

11 

1.40 

0.29 

2.04 

0.06 

22221 

C 

0 

2 

4 

-0.01 

1.32 

0.86 

-0.18 

22221 

D 

0 

6 

13 

0.09 

0.77 

2.30 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22222 

* 

-1 

3804 

95 

1.51 

0.02 

0.00 

-0.03 

22222 

A 

1 

141 

75 

2.08 

0.11 

0.93 

0.48 

22222 

B 

0 

23 

12 

0.67 

0.18 

0.76 

-0.27 

22222 

C 

0 

15 

8 

0.52 

0.22 

0.69 

-0.24 

22222 

D 

0 

9 

5 

0.09 

0.73 

0.70 

-0.25 

22223 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

22223 

A 

1 

22 

50 

2.40 

0.39 

6.51 

0.43 

22223 

B 

0 

4 

9 

1.28 

0.50 

1.10 

-0.08 

22223 

C 

0 

13 

30 

1.02 

0.36 

1.13 

-0.28 

22223 

D 

0 

5 

11 

0.79 

0.29 

0.55 

-0.20 

22224 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22224 

A 

1 

32 

71 

2.29 

0.26 

1.06 

0.48 

22224 

B 

0 

4 

9 

0.33 

0.71 

0.67 

-0.28 

22224 

C 

0 

1 

2 

2.55 

0.00 

3.49 

0.07 

22224 

D 

0 

8 

18 

0.46 

0.50 

1.10 

-0.38 

22225 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

22225 

A 

1 

31 

70 

1.58 

0.24 

1.14 

0.39 

22225 

B 

0 

3 

7 

0.00 

0.32 

0.45 

-0.25 

22225 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22225 

D 

0 

10 

23 

0.57 

0.34 

1.07 

-0.27 

22226 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22226 

A 

1 

15 

33 

2.28 

0.56 

4.92 

0.28 

22226 

B 

0 

2 

4 

2.42 

1.28 

3.63 

0.11 

22226 

C 

0 

15 

33 

1.22 

0.21 

0.77 

-0.18 

22226 

D 

0 

13 

29 

1.25 

0.41 

1.50 

-0.15 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22227 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

22227 

A 

1 

6 

13 

1.29 

0.82 

6.12 

0.06 

22227 

B 

0 

14 

31 

0.93 

0.35 

0.81 

-0.04 

22227 

C 

0 

12 

27 

1.77 

0.33 

1.70 

0.27 

22227 

D 

0 

13 

29 

0.31 

0.62 

0.82 

-0.27 

22228 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.01 

22228 

A 

1 

26 

39 

2.14 

0.38 

2.42 

0.28 

22228 

B 

0 

6 

9 

1.36 

0.49 

1.19 

-0.05 

22228 

C 

0 

10 

15 

1.37 

0.55 

1.98 

-0.07 

22228 

D 

0 

24 

36 

1.21 

0.17 

0.98 

-0.20 

22229 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22229 

A 

1 

31 

69 

1.75 

0.26 

0.89 

0.49 

22229 

B 

0 

3 

7 

0.75 

0.62 

1.41 

-0.07 

22229 

C 

0 

3 

7 

0.87 

0.96 

2.66 

-0.05 

22229 

D 

0 

8 

18 

-0.69 

0.61 

0.62 

-0.52 

22230 

* 

-1 

3790 

95 

1.50 

0.02 

0.00 

-0.05 

22230 

A 

1 

146 

72 

2.16 

0.10 

0.99 

0.40 

22230 

B 

0 

27 

13 

1.05 

0.19 

1.00 

-0.23 

22230 

C 

0 

23 

11 

1.10 

0.21 

1.18 

-0.20 

22230 

D 

0 

6 

3 

0.23 

0.86 

0.70 

-0.21 

22231 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22231 

A 

1 

16 

36 

2.02 

0.40 

2.48 

0.26 

22231 

B 

0 

6 

14 

0.35 

0.59 

0.58 

-0.31 

22231 

C 

0 

13 

30 

2.08 

0.34 

2.82 

0.25 

22231 

D 

0 

9 

20 

0.56 

0.27 

0.43 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22232 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

22232 

A 

1 

14 

30 

2.30 

0.55 

3.48 

0.40 

22232 

B 

0 

4 

9 

0.00 

0.98 

0.75 

-0.27 

22232 

C 

0 

17 

37 

0.98 

0.22 

0.85 

-0.18 

22232 

D 

0 

11 

24 

1.23 

0.30 

1.05 

-0.05 

22233 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22233 

A 

1 

34 

76 

1.70 

0.18 

0.66 

0.64 

22233 

B 

0 

5 

11 

-0.02 

0.49 

0.71 

-0.33 

22233 

C 

0 

2 

4 

-0.96 

1.13 

0.28 

-0.35 

22233 

D 

0 

4 

9 

-0.29 

0.19 

0.34 

-0.35 

22234 

* 

-1 

3788 

95 

1.50 

0.02 

0.00 

-0.04 

22234 

A 

1 

168 

82 

2.01 

0.10 

1.01 

0.42 

22234 

B 

0 

13 

6 

0.64 

0.21 

0.74 

-0.21 

22234 

C 

0 

15 

7 

0.64 

0.21 

0.81 

-0.22 

22234 

D 

0 

8 

4 

-0.05 

0.28 

0.37 

-0.26 

22235 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.05 

22235 

A 

1 

15 

33 

1.68 

0.21 

0.67 

0.54 

22235 

B 

0 

2 

4 

0.28 

0.93 

0.72 

-0.10 

22235 

C 

0 

20 

44 

0.54 

0.22 

0.95 

-0.20 

22235 

D 

0 

8 

18 

-0.11 

0.44 

0.55 

-0.36 

22236 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22236 

A 

1 

32 

73 

2.21 

0.28 

1.22 

0.59 

22236 

B 

0 

3 

7 

0.00 

0.57 

0.54 

-0.23 

22236 

C 

0 

3 

7 

0.50 

0.19 

0.69 

-0.15 

22236 

D 

0 

6 

14 

-0.72 

0.58 

0.49 

-0.49 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22237 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22237 

A 

1 

31 

69 

1.42 

0.21 

1.01 

0.44 

22237 

B 

0 

4 

9 

-0.05 

0.45 

0.57 

-0.29 

22237 

C 

0 

4 

9 

0.75 

0.65 

2.00 

-0.08 

22237 

D 

0 

6 

13 

0.18 

0.31 

0.68 

-0.29 

22238 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22238 

A 

1 

26 

57 

1.97 

0.31 

1.14 

0.47 

22238 

B 

0 

8 

17 

0.04 

0.59 

1.73 

-0.34 

22238 

C 

0 

5 

11 

0.30 

0.59 

0.98 

-0.20 

22238 

D 

0 

7 

15 

0.80 

0.45 

1.58 

-0.12 

22239 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

22239 

A 

1 

18 

39 

2.82 

0.35 

1.05 

0.54 

22239 

B 

0 

8 

17 

0.99 

0.40 

0.71 

-0.23 

22239 

C 

0 

8 

17 

1.47 

0.29 

0.90 

-0.09 

22239 

D 

0 

12 

26 

0.94 

0.46 

0.93 

-0.32 

22240 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22240 

A 

1 

16 

36 

2.61 

0.38 

0.95 

0.52 

22240 

B 

0 

6 

13 

0.91 

0.71 

1.38 

-0.14 

22240 

C 

0 

8 

18 

0.50 

0.38 

0.54 

-0.28 

22240 

D 

0 

15 

33 

1.03 

0.36 

1.27 

-0.20 

22241 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

22241 

A 

1 

15 

34 

2.18 

0.34 

0.96 

0.49 

22241 

B 

0 

4 

9 

-0.65 

0.24 

0.14 

-0.43 

22241 

C 

0 

15 

34 

1.44 

0.15 

1.22 

0.11 

22241 

D 

0 

10 

23 

0.25 

0.46 

1.11 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22242 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22242 

A 

1 

15 

33 

2.43 

0.44 

1.31 

0.47 

22242 

B 

0 

5 

11 

0.12 

0.83 

1.65 

-0.19 

22242 

C 

0 

9 

20 

1.17 

0.41 

1.60 

0.01 

22242 

D 

0 

16 

36 

0.26 

0.50 

0.93 

-0.34 

22243 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

22243 

A 

1 

18 

39 

2.42 

0.34 

1.13 

0.41 

22243 

B 

0 

4 

9 

1.01 

0.45 

0.62 

-0.16 

22243 

C 

0 

16 

35 

1.41 

0.32 

1.34 

-0.16 

22243 

D 

0 

8 

17 

1.10 

0.36 

0.78 

-0.21 

22244 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

0.00 

22244 

A 

1 

18 

41 

1.92 

0.44 

2.80 

0.20 

22244 

B 

0 

6 

14 

1.07 

0.47 

0.92 

-0.13 

22244 

C 

0 

12 

27 

0.89 

0.34 

0.87 

-0.27 

22244 

D 

0 

8 

18 

2.12 

0.37 

2.43 

0.18 

22245 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

22245 

A 

1 

17 

39 

2.37 

0.50 

1.79 

0.42 

22245 

B 

0 

3 

7 

1.61 

1.06 

3.17 

0.03 

22245 

C 

0 

12 

27 

1.31 

0.33 

1.58 

-0.03 

22245 

D 

0 

12 

27 

0.10 

0.37 

0.55 

-0.45 

22246 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22246 

A 

1 

14 

31 

2.90 

0.41 

0.86 

0.59 

22246 

B 

0 

4 

9 

1.01 

0.89 

1.89 

-0.08 

22246 

C 

0 

12 

27 

1.29 

0.32 

1.26 

-0.05 

22246 

D 

0 

15 

33 

0.29 

0.32 

0.47 

-0.48 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22247 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22247 

A 

1 

26 

58 

2.35 

0.22 

1.18 

0.47 

22247 

B 

0 

2 

4 

0.65 

1.00 

0.52 

-0.15 

22247 

C 

0 

11 

24 

1.17 

0.43 

1.47 

-0.20 

22247 

D 

0 

6 

13 

0.36 

1.01 

0.83 

-0.34 

22248 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

22248 

A 

1 

21 

46 

1.65 

0.31 

1.50 

0.42 

22248 

B 

0 

3 

7 

0.35 

0.42 

0.60 

-0.16 

22248 

C 

0 

9 

20 

0.89 

0.28 

1.21 

-0.08 

22248 

D 

0 

13 

28 

0.49 

0.22 

0.75 

-0.31 

22249 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22249 

A 

1 

31 

69 

1.82 

0.24 

0.75 

0.53 

22249 

B 

0 

3 

7 

-0.51 

0.58 

0.36 

-0.33 

22249 

C 

0 

5 

11 

0.75 

0.29 

1.03 

-0.13 

22249 

D 

0 

6 

13 

-0.06 

0.52 

0.78 

-0.36 

22250 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22250 

A 

1 

30 

65 

1.69 

0.24 

0.93 

0.42 

22250 

B 

0 

6 

13 

0.74 

0.66 

2.23 

-0.14 

22250 

C 

0 

3 

7 

0.13 

0.75 

0.73 

-0.21 

22250 

D 

0 

7 

15 

0.34 

0.38 

0.73 

-0.28 

22251 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22251 

A 

1 

36 

80 

1.67 

0.23 

0.90 

0.50 

22251 

B 

0 

3 

7 

-0.94 

0.63 

0.25 

-0.41 

22251 

C 

0 

4 

9 

0.22 

0.47 

0.78 

-0.23 

22251 

D 

0 

2 

4 

0.21 

0.36 

0.61 

-0.16 

easyCBM  CCSS  Second  Grade  Math  Measure  Development 


352 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22252 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22252 

A 

1 

18 

39 

2.00 

0.27 

0.78 

0.52 

22252 

B 

0 

6 

13 

0.16 

0.35 

0.45 

-0.32 

22252 

C 

0 

20 

43 

0.79 

0.25 

1.24 

-0.28 

22252 

D 

0 

2 

4 

1.09 

0.91 

1.25 

-0.02 

22253 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22253 

A 

1 

17 

38 

1.92 

0.44 

1.93 

0.38 

22253 

B 

0 

15 

33 

0.94 

0.32 

1.45 

-0.11 

22253 

C 

0 

6 

13 

0.80 

0.41 

0.92 

-0.10 

22253 

D 

0 

7 

16 

0.25 

0.43 

0.56 

-0.26 

22254 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

22254 

A 

1 

31 

69 

2.04 

0.20 

0.80 

0.58 

22254 

B 

0 

6 

13 

1.05 

0.09 

0.79 

-0.16 

22254 

C 

0 

4 

9 

0.17 

0.60 

0.52 

-0.35 

22254 

D 

0 

4 

9 

0.02 

0.39 

0.34 

-0.39 

22255 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

22255 

A 

1 

36 

78 

1.94 

0.25 

0.88 

0.44 

22255 

B 

0 

2 

4 

-0.36 

0.53 

0.29 

-0.27 

22255 

C 

0 

2 

4 

-0.36 

0.28 

0.26 

-0.27 

22255 

D 

0 

6 

13 

0.76 

0.30 

1.00 

-0.21 

22256 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22256 

A 

1 

30 

68 

1.64 

0.19 

1.21 

0.14 

22256 

B 

0 

2 

5 

3.75 

0.10 

11.57 

0.43 

22256 

C 

0 

6 

14 

1.35 

0.32 

1.34 

-0.06 

22256 

D 

0 

6 

14 

0.44 

0.29 

0.52 

-0.39 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22257 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22257 

A 

1 

35 

78 

1.86 

0.20 

0.80 

0.56 

22257 

B 

0 

3 

7 

0.09 

0.32 

0.44 

-0.26 

22257 

C 

0 

5 

11 

-0.34 

0.67 

0.53 

-0.46 

22257 

D 

0 

2 

4 

0.79 

0.31 

0.83 

-0.10 

22258 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22258 

A 

1 

33 

73 

2.16 

0.21 

0.70 

0.66 

22258 

B 

0 

4 

9 

-0.43 

0.41 

0.26 

-0.40 

22258 

C 

0 

3 

7 

-0.02 

0.40 

0.37 

-0.27 

22258 

D 

0 

5 

11 

0.07 

0.68 

0.65 

-0.34 

22259 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22259 

A 

1 

33 

73 

2.13 

0.23 

0.73 

0.62 

22259 

B 

0 

4 

9 

-0.20 

0.37 

0.34 

-0.35 

22259 

C 

0 

2 

4 

0.53 

0.43 

0.66 

-0.14 

22259 

D 

0 

6 

13 

-0.14 

0.39 

0.49 

-0.43 

22260 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

22260 

A 

1 

37 

80 

1.41 

0.21 

0.95 

0.41 

22260 

B 

0 

5 

11 

-0.19 

0.60 

0.92 

-0.35 

22260 

C 

0 

4 

9 

0.36 

0.30 

0.79 

-0.18 

22260 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22261 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

22261 

A 

1 

37 

82 

2.40 

0.27 

0.79 

0.55 

22261 

B 

0 

3 

7 

-0.14 

0.57 

0.41 

-0.31 

22261 

C 

0 

1 

2 

-0.38 

0.00 

0.25 

-0.20 

22261 

D 

0 

4 

9 

-0.19 

0.57 

0.46 

-0.37 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22262 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22262 

A 

1 

35 

76 

1.57 

0.20 

0.90 

0.51 

22262 

B 

0 

3 

7 

0.01 

0.82 

0.87 

-0.23 

22262 

C 

0 

5 

11 

-0.29 

0.32 

0.42 

-0.39 

22262 

D 

0 

3 

7 

0.41 

0.78 

1.31 

-0.15 

22263 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22263 

A 

1 

28 

62 

2.45 

0.21 

0.63 

0.68 

22263 

B 

0 

4 

9 

-0.12 

0.39 

0.30 

-0.35 

22263 

C 

0 

7 

16 

0.45 

0.57 

1.39 

-0.32 

22263 

D 

0 

6 

13 

0.30 

0.57 

0.70 

-0.33 

22264 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22264 

A 

1 

35 

78 

1.90 

0.26 

0.81 

0.50 

22264 

B 

0 

3 

7 

0.05 

0.90 

1.15 

-0.22 

22264 

C 

0 

5 

11 

-0.35 

0.63 

0.89 

-0.38 

22264 

D 

0 

2 

4 

0.16 

1.04 

0.90 

-0.17 

22265 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

22265 

A 

1 

30 

65 

1.73 

0.23 

0.70 

0.61 

22265 

B 

0 

6 

13 

0.05 

0.51 

0.91 

-0.27 

22265 

C 

0 

2 

4 

-0.72 

0.23 

0.23 

-0.26 

22265 

D 

0 

8 

17 

-0.14 

0.29 

0.57 

-0.38 

22266 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22266 

A 

1 

38 

84 

1.41 

0.18 

0.83 

0.48 

22266 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22266 

C 

0 

2 

4 

1.40 

0.22 

2.18 

0.04 

22266 

D 

0 

5 

11 

-1.03 

0.42 

0.24 

-0.58 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22267 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22267 

A 

1 

34 

76 

1.84 

0.21 

1.01 

0.41 

22267 

B 

0 

5 

11 

0.38 

0.45 

0.70 

-0.31 

22267 

C 

0 

5 

11 

0.93 

0.76 

2.30 

-0.16 

22267 

D 

0 

1 

2 

-0.09 

0.00 

0.30 

-0.18 

22268 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

22268 

A 

1 

20 

43 

2.22 

0.30 

1.20 

0.42 

22268 

B 

0 

19 

41 

1.40 

0.26 

1.44 

-0.06 

22268 

C 

0 

2 

4 

0.65 

0.34 

0.40 

-0.12 

22268 

D 

0 

5 

11 

-0.60 

0.72 

0.32 

-0.49 

22269 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

22269 

A 

1 

16 

35 

2.41 

0.39 

1.07 

0.47 

22269 

B 

0 

8 

17 

0.49 

0.30 

0.50 

-0.31 

22269 

C 

0 

16 

35 

1.36 

0.32 

1.57 

-0.06 

22269 

D 

0 

6 

13 

0.63 

0.37 

0.54 

-0.23 

22270 

* 

-1 

3941 

99 

1.51 

0.02 

0.00 

-0.03 

22270 

A 

1 

43 

84 

2.06 

0.19 

1.01 

0.36 

22270 

B 

0 

1 

2 

-0.03 

0.00 

0.26 

-0.21 

22270 

C 

0 

5 

10 

0.65 

0.32 

0.63 

-0.31 

22270 

D 

0 

2 

4 

1.55 

1.18 

2.21 

-0.05 

22271 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22271 

A 

1 

26 

58 

2.19 

0.22 

0.70 

0.51 

22271 

B 

0 

7 

16 

1.44 

0.69 

3.68 

-0.01 

22271 

C 

0 

7 

16 

-0.04 

0.36 

0.38 

-0.41 

22271 

D 

0 

5 

11 

0.06 

0.93 

0.96 

-0.32 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22272 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.01 

22272 

A 

1 

30 

70 

2.06 

0.22 

1.15 

0.45 

22272 

B 

0 

9 

21 

0.98 

0.40 

1.65 

-0.26 

22272 

C 

0 

3 

7 

0.48 

1.05 

1.20 

-0.24 

22272 

D 

0 

1 

2 

-0.75 

0.00 

0.12 

-0.27 

22273 

* 

-1 

3945 

99 

1.52 

0.02 

0.00 

0.04 

22273 

A 

1 

36 

77 

1.25 

0.25 

1.35 

0.26 

22273 

B 

0 

4 

9 

1.09 

0.74 

4.63 

0.01 

22273 

C 

0 

3 

6 

-0.91 

0.59 

0.32 

-0.33 

22273 

D 

0 

4 

9 

0.42 

0.88 

1.80 

-0.12 

22274 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22274 

A 

1 

26 

58 

1.73 

0.29 

1.09 

0.39 

22274 

B 

0 

11 

24 

0.80 

0.35 

1.39 

-0.17 

22274 

C 

0 

2 

4 

0.68 

0.90 

1.01 

-0.08 

22274 

D 

0 

6 

13 

0.10 

0.55 

0.63 

-0.31 

22275 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22275 

A 

1 

31 

69 

1.82 

0.18 

0.65 

0.63 

22275 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22275 

C 

0 

6 

13 

-0.15 

0.24 

0.40 

-0.34 

22275 

D 

0 

8 

18 

-0.31 

0.74 

1.56 

-0.46 

22276 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22276 

A 

1 

24 

53 

2.09 

0.33 

1.41 

0.45 

22276 

B 

0 

4 

9 

1.07 

0.44 

1.06 

-0.05 

22276 

C 

0 

12 

27 

1.03 

0.28 

1.29 

-0.12 

22276 

D 

0 

5 

11 

-1.05 

0.92 

0.28 

-0.50 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22277 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22277 

A 

1 

14 

31 

2.62 

0.29 

0.56 

0.62 

22277 

B 

0 

24 

53 

0.86 

0.23 

0.96 

-0.42 

22277 

C 

0 

4 

9 

0.36 

0.39 

0.39 

-0.24 

22277 

D 

0 

3 

7 

1.16 

0.67 

1.07 

-0.04 

22278 

* 

-1 

3950 

99 

1.51 

0.02 

0.00 

-0.01 

22278 

A 

1 

21 

50 

2.50 

0.32 

0.96 

0.48 

22278 

B 

0 

15 

36 

1.36 

0.30 

1.37 

-0.16 

22278 

C 

0 

1 

2 

-1.73 

0.00 

0.04 

-0.33 

22278 

D 

0 

5 

12 

0.20 

0.77 

0.70 

-0.34 

22279 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22279 

A 

1 

33 

73 

1.73 

0.22 

0.94 

0.46 

22279 

B 

0 

3 

7 

-0.20 

0.45 

0.36 

-0.32 

22279 

C 

0 

1 

2 

1.60 

0.00 

1.83 

0.03 

22279 

D 

0 

8 

18 

0.40 

0.39 

0.86 

-0.34 

22280 

* 

-1 

3790 

95 

1.52 

0.02 

0.00 

0.02 

22280 

A 

1 

154 

76 

1.68 

0.10 

0.96 

0.38 

22280 

B 

0 

20 

10 

0.44 

0.27 

1.10 

-0.24 

22280 

C 

0 

23 

11 

0.53 

0.20 

1.03 

-0.24 

22280 

D 

0 

5 

2 

0.53 

0.35 

0.75 

-0.11 

22281 

* 

-1 

3778 

95 

1.51 

0.02 

0.00 

-0.02 

22281 

A 

1 

170 

79 

1.93 

0.09 

0.95 

0.45 

22281 

B 

0 

13 

6 

0.73 

0.25 

0.88 

-0.18 

22281 

C 

0 

25 

12 

0.77 

0.22 

1.05 

-0.24 

22281 

D 

0 

6 

3 

-1.11 

0.71 

0.20 

-0.36 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22282 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

22282 

A 

1 

24 

52 

1.65 

0.22 

1.16 

0.32 

22282 

B 

0 

5 

11 

1.19 

0.37 

1.15 

-0.04 

22282 

C 

0 

11 

24 

0.77 

0.40 

1.09 

-0.28 

22282 

D 

0 

6 

13 

1.08 

0.24 

0.97 

-0.08 

22283 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

22283 

A 

1 

28 

64 

1.99 

0.26 

0.98 

0.59 

22283 

B 

0 

4 

9 

0.12 

0.32 

0.48 

-0.23 

22283 

C 

0 

4 

9 

-0.14 

0.51 

0.43 

-0.29 

22283 

D 

0 

8 

18 

0.12 

0.54 

0.84 

-0.35 

22284 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22284 

A 

1 

32 

71 

1.59 

0.19 

0.94 

0.43 

22284 

B 

0 

5 

11 

0.83 

0.23 

0.90 

-0.14 

22284 

C 

0 

3 

7 

0.36 

0.78 

0.94 

-0.22 

22284 

D 

0 

5 

11 

0.33 

0.53 

0.71 

-0.30 

22285 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

0.00 

22285 

A 

1 

17 

40 

2.03 

0.35 

2.07 

0.31 

22285 

B 

0 

18 

42 

1.28 

0.22 

1.01 

-0.20 

22285 

C 

0 

4 

9 

1.10 

0.11 

0.57 

-0.13 

22285 

D 

0 

4 

9 

1.39 

0.79 

1.88 

-0.05 

22286 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22286 

A 

1 

25 

56 

1.68 

0.19 

0.89 

0.45 

22286 

B 

0 

7 

16 

0.55 

0.45 

0.93 

-0.24 

22286 

C 

0 

11 

24 

0.69 

0.41 

1.65 

-0.25 

22286 

D 

0 

2 

4 

0.32 

1.10 

0.73 

-0.16 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22287 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22287 

A 

1 

29 

64 

1.44 

0.25 

1.48 

0.11 

22287 

B 

0 

10 

22 

1.69 

0.58 

5.83 

0.13 

22287 

C 

0 

2 

4 

1.14 

1.70 

3.08 

-0.02 

22287 

D 

0 

4 

9 

-0.44 

0.46 

0.31 

-0.36 

22288 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

22288 

A 

1 

29 

63 

1.94 

0.31 

1.20 

0.42 

22288 

B 

0 

9 

20 

1.29 

0.36 

2.19 

-0.03 

22288 

C 

0 

6 

13 

-0.28 

0.33 

0.34 

-0.39 

22288 

D 

0 

2 

4 

-0.93 

1.08 

0.23 

-0.30 

22289 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22289 

A 

1 

23 

51 

1.76 

0.27 

1.24 

0.32 

22289 

B 

0 

8 

18 

0.96 

0.51 

1.82 

-0.15 

22289 

C 

0 

6 

13 

1.12 

0.45 

1.33 

-0.08 

22289 

D 

0 

8 

18 

0.85 

0.33 

0.88 

-0.19 

22290 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22290 

A 

1 

31 

69 

1.73 

0.20 

0.92 

0.45 

22290 

B 

0 

2 

4 

-1.16 

0.58 

0.13 

-0.41 

22290 

C 

0 

6 

13 

1.46 

0.40 

2.18 

0.04 

22290 

D 

0 

6 

13 

0.02 

0.47 

0.67 

-0.40 

22291 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22291 

A 

1 

35 

80 

1.89 

0.26 

1.10 

0.48 

22291 

B 

0 

4 

9 

0.10 

0.28 

0.53 

-0.28 

22291 

C 

0 

3 

7 

0.28 

0.92 

1.15 

-0.21 

22291 

D 

0 

2 

5 

-0.59 

0.07 

0.24 

-0.29 

easyCBM  CCSS  Second  Grade  Math  Measure  Development 


360 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22292 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22292 

A 

1 

8 

17 

2.69 

0.49 

0.69 

0.47 

22292 

B 

0 

13 

28 

1.00 

0.35 

1.09 

-0.12 

22292 

C 

0 

14 

30 

1.14 

0.34 

1.14 

-0.06 

22292 

D 

0 

11 

24 

0.71 

0.34 

0.63 

-0.23 

22293 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

22293 

A 

1 

28 

64 

1.96 

0.24 

0.71 

0.71 

22293 

B 

0 

2 

5 

-0.60 

0.33 

0.28 

-0.22 

22293 

C 

0 

4 

9 

-0.35 

0.47 

0.47 

-0.28 

22293 

D 

0 

10 

23 

-0.48 

0.35 

0.50 

-0.52 

22294 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

22294 

A 

1 

37 

84 

1.87 

0.21 

0.93 

0.41 

22294 

B 

0 

1 

2 

0.04 

0.00 

0.34 

-0.19 

22294 

C 

0 

2 

5 

1.07 

0.29 

1.00 

-0.10 

22294 

D 

0 

4 

9 

0.16 

0.34 

0.46 

-0.36 

22295 

* 

-1 

3944 

99 

1.52 

0.02 

0.00 

0.00 

22295 

A 

1 

40 

83 

1.84 

0.18 

0.78 

0.53 

22295 

B 

0 

3 

6 

-0.29 

0.23 

0.28 

-0.37 

22295 

C 

0 

2 

4 

0.30 

1.39 

1.01 

-0.20 

22295 

D 

0 

3 

6 

0.14 

0.71 

0.67 

-0.28 

22296 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22296 

A 

1 

24 

52 

2.02 

0.30 

1.60 

0.49 

22296 

B 

0 

9 

20 

1.25 

0.44 

2.09 

-0.01 

22296 

C 

0 

6 

13 

0.12 

0.40 

0.53 

-0.29 

22296 

D 

0 

7 

15 

-0.19 

0.41 

0.40 

-0.40 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22297 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22297 

A 

1 

25 

54 

2.07 

0.23 

0.90 

0.61 

22297 

B 

0 

5 

11 

1.06 

0.52 

1.74 

-0.06 

22297 

C 

0 

3 

7 

-0.12 

0.63 

0.37 

-0.27 

22297 

D 

0 

13 

28 

0.18 

0.27 

0.53 

-0.50 

22298 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22298 

A 

1 

19 

42 

2.22 

0.43 

4.27 

0.35 

22298 

B 

0 

9 

20 

1.83 

0.46 

2.31 

0.09 

22298 

C 

0 

10 

22 

0.81 

0.40 

0.84 

-0.22 

22298 

D 

0 

7 

16 

0.19 

0.58 

0.56 

-0.33 

22299 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22299 

A 

1 

19 

42 

2.44 

0.22 

0.59 

0.66 

22299 

B 

0 

12 

27 

1.05 

0.30 

0.97 

-0.10 

22299 

C 

0 

5 

11 

-0.13 

0.74 

0.62 

-0.34 

22299 

D 

0 

9 

20 

-0.02 

0.37 

0.37 

-0.44 

22300 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22300 

A 

1 

34 

76 

1.81 

0.21 

0.74 

0.58 

22300 

B 

0 

3 

7 

0.31 

0.85 

0.95 

-0.15 

22300 

C 

0 

1 

2 

0.92 

0.00 

1.05 

-0.03 

22300 

D 

0 

7 

16 

-1.01 

0.78 

0.34 

-0.58 

22301 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22301 

A 

1 

36 

80 

2.01 

0.21 

0.93 

0.44 

22301 

B 

0 

4 

9 

0.77 

0.17 

0.64 

-0.24 

22301 

C 

0 

2 

4 

0.32 

0.25 

0.40 

-0.24 

22301 

D 

0 

3 

7 

0.64 

0.21 

0.57 

-0.23 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22302 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

22302 

A 

1 

32 

73 

1.75 

0.24 

0.76 

0.53 

22302 

B 

0 

2 

5 

-0.19 

0.99 

0.54 

-0.23 

22302 

C 

0 

5 

11 

-0.12 

0.33 

0.47 

-0.35 

22302 

D 

0 

5 

11 

0.31 

0.34 

0.75 

-0.24 

22303 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

22303 

A 

1 

29 

67 

1.88 

0.29 

1.20 

0.44 

22303 

B 

0 

6 

14 

0.42 

0.36 

0.91 

-0.25 

22303 

C 

0 

4 

9 

0.35 

0.54 

0.76 

-0.21 

22303 

D 

0 

4 

9 

0.43 

0.87 

2.20 

-0.20 

22304 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22304 

A 

1 

27 

60 

2.04 

0.30 

1.06 

0.57 

22304 

B 

0 

7 

16 

0.08 

0.48 

1.09 

-0.25 

22304 

C 

0 

3 

7 

0.04 

0.75 

0.67 

-0.16 

22304 

D 

0 

8 

18 

-0.38 

0.73 

1.48 

-0.38 

22305 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

0.00 

22305 

A 

1 

34 

74 

1.99 

0.18 

0.91 

0.57 

22305 

B 

0 

6 

13 

0.53 

0.38 

0.62 

-0.34 

22305 

C 

0 

4 

9 

-0.01 

0.45 

0.38 

-0.41 

22305 

D 

0 

2 

4 

0.98 

0.26 

0.78 

-0.10 

22306 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

22306 

A 

1 

26 

59 

1.92 

0.24 

1.09 

0.46 

22306 

B 

0 

7 

16 

0.98 

0.35 

1.08 

-0.15 

22306 

C 

0 

6 

14 

0.02 

0.44 

0.42 

-0.43 

22306 

D 

0 

5 

11 

1.19 

0.57 

1.45 

-0.07 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22307 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22307 

A 

1 

22 

49 

1.59 

0.32 

1.70 

0.17 

22307 

B 

0 

4 

9 

1.14 

0.94 

3.20 

-0.05 

22307 

C 

0 

7 

16 

1.80 

0.34 

2.29 

0.14 

22307 

D 

0 

12 

27 

0.69 

0.38 

1.08 

-0.28 

22308 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

22308 

A 

1 

26 

57 

1.84 

0.32 

1.28 

0.54 

22308 

B 

0 

7 

15 

0.51 

0.33 

1.01 

-0.14 

22308 

C 

0 

6 

13 

0.13 

0.43 

0.80 

-0.22 

22308 

D 

0 

7 

15 

-0.46 

0.45 

0.48 

-0.39 

22309 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

22309 

A 

1 

18 

39 

2.09 

0.42 

1.76 

0.45 

22309 

B 

0 

12 

26 

0.89 

0.37 

1.50 

-0.14 

22309 

C 

0 

11 

24 

0.83 

0.25 

0.97 

-0.15 

22309 

D 

0 

5 

11 

-0.06 

0.39 

0.40 

-0.30 

22310 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22310 

A 

1 

28 

62 

1.76 

0.25 

1.01 

0.46 

22310 

B 

0 

6 

13 

0.18 

0.46 

0.66 

-0.34 

22310 

C 

0 

9 

20 

0.80 

0.27 

1.08 

-0.20 

22310 

D 

0 

2 

4 

0.52 

0.22 

0.59 

-0.13 

22311 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

22311 

A 

1 

15 

34 

1.91 

0.41 

1.81 

0.33 

22311 

B 

0 

7 

16 

1.27 

0.42 

1.34 

-0.01 

22311 

C 

0 

8 

18 

1.13 

0.46 

1.66 

-0.07 

22311 

D 

0 

14 

32 

0.80 

0.23 

0.76 

-0.27 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22312 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22312 

A 

1 

32 

71 

1.86 

0.23 

1.09 

0.31 

22312 

B 

0 

3 

7 

1.21 

0.25 

1.01 

-0.07 

22312 

C 

0 

6 

13 

0.98 

0.57 

1.68 

-0.18 

22312 

D 

0 

4 

9 

0.68 

0.99 

1.41 

-0.21 

22313 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.05 

22313 

A 

1 

17 

39 

1.85 

0.26 

0.69 

0.64 

22313 

B 

0 

13 

30 

0.32 

0.21 

0.65 

-0.29 

22313 

C 

0 

7 

16 

0.68 

0.36 

1.04 

-0.07 

22313 

D 

0 

7 

16 

-0.31 

0.30 

0.35 

-0.43 

22314 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22314 

A 

1 

20 

45 

2.19 

0.20 

0.74 

0.56 

22314 

B 

0 

7 

16 

1.31 

0.44 

1.54 

-0.05 

22314 

C 

0 

7 

16 

0.20 

0.34 

0.38 

-0.45 

22314 

D 

0 

10 

23 

0.96 

0.35 

0.87 

-0.22 

22315 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22315 

A 

1 

38 

84 

2.02 

0.25 

0.93 

0.55 

22315 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22315 

C 

0 

4 

9 

0.45 

0.40 

1.00 

-0.19 

22315 

D 

0 

3 

7 

-2.37 

0.70 

0.07 

-0.58 

22316 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22316 

A 

1 

24 

53 

2.68 

0.32 

1.09 

0.57 

22316 

B 

0 

11 

24 

1.17 

0.34 

1.30 

-0.24 

22316 

C 

0 

4 

9 

0.26 

0.35 

0.36 

-0.31 

22316 

D 

0 

6 

13 

0.76 

0.34 

0.65 

-0.27 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22317 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22317 

A 

1 

23 

51 

1.99 

0.32 

1.35 

0.38 

22317 

B 

0 

9 

20 

0.92 

0.38 

1.26 

-0.17 

22317 

C 

0 

5 

11 

1.54 

0.45 

1.87 

0.03 

22317 

D 

0 

8 

18 

0.31 

0.52 

1.07 

-0.34 

22318 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22318 

A 

1 

32 

71 

2.11 

0.25 

1.00 

0.47 

22318 

B 

0 

5 

11 

0.71 

0.77 

1.86 

-0.23 

22318 

C 

0 

2 

4 

0.22 

0.78 

0.49 

-0.21 

22318 

D 

0 

6 

13 

0.62 

0.18 

0.59 

-0.28 

22319 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22319 

A 

1 

22 

49 

1.74 

0.30 

1.46 

0.31 

22319 

B 

0 

9 

20 

0.63 

0.36 

0.81 

-0.22 

22319 

C 

0 

5 

11 

1.76 

0.80 

7.50 

0.12 

22319 

D 

0 

9 

20 

0.54 

0.51 

1.16 

-0.25 

22320 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22320 

A 

1 

19 

43 

2.18 

0.36 

1.36 

0.42 

22320 

B 

0 

11 

25 

0.96 

0.32 

1.02 

-0.19 

22320 

C 

0 

8 

18 

0.84 

0.38 

0.86 

-0.19 

22320 

D 

0 

6 

14 

0.87 

0.75 

1.65 

-0.15 

22321 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22321 

A 

1 

24 

53 

2.15 

0.35 

1.33 

0.40 

22321 

B 

0 

3 

7 

-0.34 

0.27 

0.22 

-0.32 

22321 

C 

0 

12 

27 

1.18 

0.38 

1.96 

-0.14 

22321 

D 

0 

6 

13 

0.89 

0.37 

1.08 

-0.16 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22322 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.05 

22322 

A 

1 

20 

45 

1.47 

0.20 

0.88 

0.42 

22322 

B 

0 

8 

18 

1.40 

0.38 

2.69 

0.19 

22322 

C 

0 

7 

16 

0.47 

0.50 

1.15 

-0.11 

22322 

D 

0 

9 

20 

-0.83 

0.48 

0.29 

-0.60 

22323 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22323 

A 

1 

24 

53 

2.50 

0.29 

1.19 

0.52 

22323 

B 

0 

13 

29 

1.16 

0.34 

0.94 

-0.24 

22323 

C 

0 

2 

4 

1.71 

1.01 

1.64 

0.00 

22323 

D 

0 

6 

13 

-0.02 

0.42 

0.26 

-0.45 

22324 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22324 

A 

1 

20 

44 

2.19 

0.29 

1.25 

0.41 

22324 

B 

0 

7 

16 

1.78 

0.38 

1.90 

0.07 

22324 

C 

0 

8 

18 

1.35 

0.45 

1.81 

-0.07 

22324 

D 

0 

10 

22 

0.26 

0.39 

0.47 

-0.49 

22325 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22325 

A 

1 

25 

57 

2.22 

0.25 

1.19 

0.57 

22325 

B 

0 

4 

9 

-0.08 

0.42 

0.29 

-0.39 

22325 

C 

0 

11 

25 

0.75 

0.23 

0.65 

-0.35 

22325 

D 

0 

4 

9 

1.25 

0.25 

0.94 

-0.07 

22326 

* 

-1 

3942 

99 

1.52 

0.02 

0.00 

0.02 

22326 

A 

1 

28 

56 

1.65 

0.22 

1.44 

0.30 

22326 

B 

0 

2 

4 

1.30 

0.52 

1.15 

0.00 

22326 

C 

0 

12 

24 

1.32 

0.31 

2.02 

0.00 

22326 

D 

0 

8 

16 

0.09 

0.59 

0.64 

-0.41 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22327 

* 

-1 

3794 

95 

1.51 

0.02 

0.00 

-0.01 

22327 

A 

1 

134 

68 

2.02 

0.10 

0.89 

0.47 

22327 

B 

0 

30 

15 

0.87 

0.18 

1.04 

-0.23 

22327 

C 

0 

28 

14 

0.74 

0.20 

0.91 

-0.27 

22327 

D 

0 

6 

3 

-0.35 

0.79 

0.39 

-0.27 

22328 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22328 

A 

1 

29 

64 

1.96 

0.23 

0.79 

0.53 

22328 

B 

0 

6 

13 

1.03 

0.58 

3.01 

-0.10 

22328 

C 

0 

7 

16 

0.08 

0.29 

0.48 

-0.38 

22328 

D 

0 

3 

7 

-0.45 

0.90 

0.38 

-0.34 

22329 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22329 

A 

1 

31 

69 

1.58 

0.32 

1.58 

0.30 

22329 

B 

0 

7 

16 

0.37 

0.42 

1.08 

-0.23 

22329 

C 

0 

5 

11 

0.92 

0.54 

1.92 

-0.07 

22329 

D 

0 

2 

4 

0.14 

0.25 

0.56 

-0.15 

22330 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.03 

22330 

A 

1 

28 

65 

2.75 

0.28 

0.95 

0.65 

22330 

B 

0 

6 

14 

0.23 

0.27 

0.36 

-0.41 

22330 

C 

0 

5 

12 

0.67 

0.50 

0.71 

-0.28 

22330 

D 

0 

4 

9 

0.53 

0.30 

0.47 

-0.27 

22331 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22331 

A 

1 

34 

77 

1.86 

0.25 

0.98 

0.48 

22331 

B 

0 

3 

7 

-0.27 

0.82 

0.58 

-0.30 

22331 

C 

0 

2 

5 

0.07 

0.30 

0.45 

-0.20 

22331 

D 

0 

5 

11 

0.33 

0.42 

0.78 

-0.26 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22332 

* 

-1 

3812 

95 

1.50 

0.02 

0.00 

-0.05 

22332 

A 

1 

164 

91 

2.03 

0.12 

0.98 

0.36 

22332 

B 

0 

6 

3 

-0.14 

0.32 

0.39 

-0.24 

22332 

C 

0 

9 

5 

0.40 

0.27 

0.68 

-0.22 

22332 

D 

0 

1 

1 

-0.92 

0.00 

0.14 

-0.14 

22333 

* 

-1 

3945 

99 

1.51 

0.02 

0.00 

-0.01 

22333 

A 

1 

28 

60 

2.41 

0.26 

0.73 

0.60 

22333 

B 

0 

4 

9 

0.46 

0.78 

0.90 

-0.23 

22333 

C 

0 

9 

19 

0.97 

0.22 

0.89 

-0.21 

22333 

D 

0 

6 

13 

-0.18 

0.47 

0.38 

-0.44 

22334 

* 

-1 

3936 

99 

1.52 

0.02 

0.00 

0.01 

22334 

A 

1 

33 

59 

2.16 

0.21 

0.72 

0.62 

22334 

B 

0 

4 

7 

0.04 

0.24 

0.34 

-0.26 

22334 

C 

0 

5 

9 

0.41 

0.50 

0.83 

-0.22 

22334 

D 

0 

14 

25 

0.39 

0.31 

0.67 

-0.41 

22335 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22335 

A 

1 

29 

66 

2.02 

0.27 

1.32 

0.49 

22335 

B 

0 

5 

11 

0.52 

0.51 

0.90 

-0.24 

22335 

C 

0 

2 

5 

0.31 

0.24 

0.46 

-0.18 

22335 

D 

0 

8 

18 

0.54 

0.28 

0.79 

-0.31 

22336 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22336 

A 

1 

28 

62 

2.05 

0.25 

0.67 

0.65 

22336 

B 

0 

5 

11 

0.34 

0.48 

1.01 

-0.17 

22336 

C 

0 

7 

16 

-0.44 

0.61 

0.60 

-0.41 

22336 

D 

0 

5 

11 

-0.59 

0.51 

0.44 

-0.37 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22337 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22337 

A 

1 

24 

53 

2.37 

0.27 

0.82 

0.63 

22337 

B 

0 

7 

16 

1.09 

0.45 

1.30 

-0.10 

22337 

C 

0 

2 

4 

0.74 

0.85 

0.80 

-0.10 

22337 

D 

0 

12 

27 

-0.06 

0.29 

0.38 

-0.58 

22338 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22338 

A 

1 

31 

69 

2.38 

0.25 

0.80 

0.60 

22338 

B 

0 

5 

11 

0.77 

0.40 

0.80 

-0.24 

22338 

C 

0 

2 

4 

-0.09 

0.57 

0.30 

-0.27 

22338 

D 

0 

7 

16 

0.38 

0.20 

0.48 

-0.40 

22339 

* 

-1 

3943 

99 

1.52 

0.02 

0.00 

0.00 

22339 

A 

1 

35 

71 

2.04 

0.22 

0.74 

0.55 

22339 

B 

0 

6 

12 

0.60 

0.71 

2.38 

-0.23 

22339 

C 

0 

2 

4 

0.00 

0.18 

0.36 

-0.21 

22339 

D 

0 

6 

12 

-0.13 

0.26 

0.39 

-0.41 

22340 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

22340 

A 

1 

30 

68 

2.27 

0.28 

0.77 

0.59 

22340 

B 

0 

2 

5 

0.04 

0.56 

0.42 

-0.20 

22340 

C 

0 

5 

11 

0.68 

0.57 

1.25 

-0.19 

22340 

D 

0 

7 

16 

-0.25 

0.39 

0.38 

-0.47 

22341 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22341 

A 

1 

24 

53 

2.18 

0.27 

0.75 

0.63 

22341 

B 

0 

12 

27 

0.70 

0.26 

0.89 

-0.28 

22341 

C 

0 

1 

2 

0.13 

0.00 

0.37 

-0.13 

22341 

D 

0 

8 

18 

0.01 

0.23 

0.41 

-0.44 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22342 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

22342 

A 

1 

33 

72 

1.83 

0.22 

0.90 

0.57 

22342 

B 

0 

4 

9 

0.39 

0.29 

0.67 

-0.21 

22342 

C 

0 

3 

7 

-0.32 

0.28 

0.31 

-0.31 

22342 

D 

0 

6 

13 

0.06 

0.48 

0.67 

-0.35 

22343 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22343 

A 

1 

32 

71 

2.36 

0.20 

0.74 

0.62 

22343 

B 

0 

6 

13 

0.77 

0.34 

0.72 

-0.30 

22343 

C 

0 

1 

2 

0.41 

0.00 

0.36 

-0.15 

22343 

D 

0 

6 

13 

0.17 

0.46 

0.53 

-0.47 

22344 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

22344 

A 

1 

19 

43 

2.28 

0.34 

0.72 

0.61 

22344 

B 

0 

5 

11 

0.84 

0.19 

0.77 

-0.13 

22344 

C 

0 

11 

25 

0.48 

0.28 

0.70 

-0.35 

22344 

D 

0 

9 

20 

0.59 

0.15 

0.62 

-0.27 

22345 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22345 

A 

1 

36 

80 

1.53 

0.19 

0.89 

0.50 

22345 

B 

0 

4 

9 

0.08 

0.61 

0.89 

-0.28 

22345 

C 

0 

3 

7 

-0.37 

0.79 

0.59 

-0.33 

22345 

D 

0 

2 

4 

0.14 

0.22 

0.54 

-0.18 

22346 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

22346 

A 

1 

27 

61 

2.35 

0.25 

0.75 

0.65 

22346 

B 

0 

8 

18 

0.43 

0.30 

0.59 

-0.37 

22346 

C 

0 

6 

14 

0.50 

0.36 

0.60 

-0.30 

22346 

D 

0 

3 

7 

0.03 

0.38 

0.33 

-0.29 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22347 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22347 

A 

1 

29 

64 

1.93 

0.28 

1.34 

0.47 

22347 

B 

0 

4 

9 

1.03 

0.16 

0.93 

-0.09 

22347 

C 

0 

3 

7 

0.26 

0.51 

0.54 

-0.23 

22347 

D 

0 

9 

20 

0.47 

0.12 

0.55 

-0.35 

22348 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22348 

A 

1 

29 

64 

1.99 

0.27 

0.97 

0.45 

22348 

B 

0 

6 

13 

0.65 

0.49 

0.96 

-0.24 

22348 

C 

0 

5 

11 

0.40 

0.43 

0.70 

-0.27 

22348 

D 

0 

5 

11 

0.90 

0.35 

1.01 

-0.15 

22349 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

22349 

A 

1 

32 

71 

2.14 

0.17 

0.79 

0.55 

22349 

B 

0 

8 

18 

0.84 

0.39 

0.77 

-0.36 

22349 

C 

0 

1 

2 

1.90 

0.00 

1.48 

0.02 

22349 

D 

0 

4 

9 

0.27 

0.32 

0.34 

-0.40 

22350 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

22350 

A 

1 

26 

59 

1.97 

0.30 

1.14 

0.46 

22350 

B 

0 

5 

11 

1.72 

0.38 

2.44 

0.08 

22350 

C 

0 

2 

5 

1.28 

0.41 

1.32 

-0.01 

22350 

D 

0 

11 

25 

-0.20 

0.29 

0.39 

-0.57 

22351 

* 

-1 

3794 

95 

1.52 

0.02 

0.00 

0.00 

22351 

A 

1 

150 

76 

1.73 

0.10 

1.09 

0.35 

22351 

B 

0 

21 

11 

0.98 

0.15 

1.04 

-0.14 

22351 

C 

0 

19 

10 

1.04 

0.19 

1.23 

-0.12 

22351 

D 

0 

8 

4 

-0.69 

0.52 

0.26 

-0.36 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22352 

* 

-1 

3944 

99 

1.52 

0.02 

0.00 

0.02 

22352 

A 

1 

39 

81 

1.59 

0.23 

0.94 

0.44 

22352 

B 

0 

2 

4 

-0.02 

0.61 

0.56 

-0.18 

22352 

C 

0 

4 

8 

-0.60 

0.44 

0.35 

-0.38 

22352 

D 

0 

3 

6 

0.53 

0.60 

1.12 

-0.13 

22353 

* 

-1 

3793 

95 

1.50 

0.02 

0.00 

-0.03 

22353 

A 

1 

170 

85 

2.06 

0.11 

0.87 

0.52 

22353 

B 

0 

7 

4 

-0.02 

0.22 

0.40 

-0.22 

22353 

C 

0 

16 

8 

-0.13 

0.20 

0.43 

-0.36 

22353 

D 

0 

6 

3 

-0.45 

0.23 

0.26 

-0.25 

22354 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22354 

A 

1 

22 

49 

2.59 

0.28 

0.61 

0.68 

22354 

B 

0 

11 

24 

0.79 

0.37 

1.12 

-0.23 

22354 

C 

0 

4 

9 

-0.64 

0.27 

0.16 

-0.40 

22354 

D 

0 

8 

18 

0.30 

0.23 

0.45 

-0.33 

22355 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.02 

22355 

A 

1 

21 

49 

1.81 

0.36 

2.26 

0.40 

22355 

B 

0 

8 

19 

1.11 

0.37 

1.71 

-0.03 

22355 

C 

0 

10 

23 

0.30 

0.30 

0.64 

-0.34 

22355 

D 

0 

4 

9 

0.58 

0.54 

0.87 

-0.14 

22356 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22356 

A 

1 

29 

64 

2.45 

0.26 

1.10 

0.60 

22356 

B 

0 

6 

13 

0.37 

0.52 

0.54 

-0.27 

22356 

C 

0 

4 

9 

-0.04 

0.66 

0.43 

-0.29 

22356 

D 

0 

6 

13 

0.10 

0.93 

1.00 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22357 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22357 

A 

1 

19 

42 

2.17 

0.27 

0.62 

0.64 

22357 

B 

0 

6 

13 

-0.07 

0.35 

0.40 

-0.34 

22357 

C 

0 

13 

29 

0.65 

0.30 

0.92 

-0.21 

22357 

D 

0 

7 

16 

0.18 

0.40 

0.55 

-0.29 

22358 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

22358 

A 

1 

32 

70 

1.97 

0.19 

0.88 

0.58 

22358 

B 

0 

5 

11 

-0.17 

0.26 

0.27 

-0.50 

22358 

C 

0 

3 

7 

1.09 

0.49 

1.03 

-0.09 

22358 

D 

0 

6 

13 

0.72 

0.19 

0.63 

-0.26 

22359 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22359 

A 

1 

28 

62 

2.06 

0.23 

0.86 

0.56 

22359 

B 

0 

5 

11 

0.99 

0.26 

0.93 

-0.12 

22359 

C 

0 

6 

13 

0.03 

0.44 

0.50 

-0.40 

22359 

D 

0 

6 

13 

0.44 

0.62 

1.22 

-0.28 

22360 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22360 

A 

1 

24 

53 

2.04 

0.31 

1.40 

0.39 

22360 

B 

0 

4 

9 

0.21 

0.33 

0.37 

-0.27 

22360 

C 

0 

5 

11 

1.54 

0.67 

2.71 

0.01 

22360 

D 

0 

12 

27 

0.82 

0.39 

1.08 

-0.27 

22361 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

22361 

A 

1 

29 

66 

1.78 

0.28 

1.05 

0.50 

22361 

B 

0 

3 

7 

0.01 

0.43 

0.48 

-0.23 

22361 

C 

0 

6 

14 

0.53 

0.33 

0.95 

-0.20 

22361 

D 

0 

6 

14 

0.10 

0.25 

0.52 

-0.32 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22362 

* 

-1 

3931 

98 

1.52 

0.02 

0.00 

0.00 

22362 

A 

1 

45 

74 

2.00 

0.18 

0.71 

0.62 

22362 

B 

0 

9 

15 

0.24 

0.22 

0.53 

-0.36 

22362 

C 

0 

3 

5 

0.09 

0.19 

0.38 

-0.22 

22362 

D 

0 

4 

7 

-0.54 

0.66 

0.35 

-0.38 

22363 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22363 

A 

1 

36 

80 

2.05 

0.22 

0.59 

0.63 

22363 

B 

0 

2 

4 

-0.85 

0.87 

0.24 

-0.32 

22363 

C 

0 

1 

2 

0.37 

0.00 

0.58 

-0.11 

22363 

D 

0 

6 

13 

-0.56 

0.49 

0.38 

-0.51 

22364 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22364 

A 

1 

32 

71 

2.01 

0.21 

0.84 

0.65 

22364 

B 

0 

3 

7 

0.74 

0.48 

0.91 

-0.12 

22364 

C 

0 

6 

13 

-0.73 

0.39 

0.26 

-0.56 

22364 

D 

0 

4 

9 

0.11 

0.55 

0.56 

-0.27 

22365 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.05 

22365 

A 

1 

29 

63 

1.28 

0.29 

1.92 

0.39 

22365 

B 

0 

5 

11 

0.14 

0.39 

0.83 

-0.16 

22365 

C 

0 

2 

4 

-0.70 

1.44 

0.60 

-0.21 

22365 

D 

0 

10 

22 

0.14 

0.37 

1.19 

-0.24 

22366 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

22366 

A 

1 

32 

70 

2.06 

0.29 

0.85 

0.54 

22366 

B 

0 

5 

11 

0.11 

0.43 

0.71 

-0.22 

22366 

C 

0 

4 

9 

-0.12 

0.67 

0.85 

-0.24 

22366 

D 

0 

5 

11 

-0.68 

1.20 

1.54 

-0.37 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22367 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

22367 

A 

1 

27 

60 

2.33 

0.28 

0.97 

0.59 

22367 

B 

0 

4 

9 

0.73 

0.47 

0.86 

-0.17 

22367 

C 

0 

7 

16 

0.72 

0.18 

0.66 

-0.24 

22367 

D 

0 

7 

16 

0.04 

0.49 

0.52 

-0.42 

22368 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22368 

A 

1 

24 

53 

2.41 

0.31 

0.96 

0.52 

22368 

B 

0 

11 

24 

1.18 

0.46 

2.04 

-0.15 

22368 

C 

0 

5 

11 

0.57 

0.37 

0.64 

-0.23 

22368 

D 

0 

5 

11 

-0.13 

0.39 

0.32 

-0.38 

22369 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

22369 

A 

1 

33 

77 

1.74 

0.17 

0.92 

0.55 

22369 

B 

0 

2 

5 

1.02 

1.00 

1.41 

-0.08 

22369 

C 

0 

3 

7 

0.05 

0.66 

0.49 

-0.33 

22369 

D 

0 

5 

12 

0.13 

0.25 

0.43 

-0.41 

22370 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22370 

A 

1 

32 

71 

1.96 

0.20 

0.84 

0.64 

22370 

B 

0 

4 

9 

-0.58 

0.44 

0.28 

-0.41 

22370 

C 

0 

5 

11 

0.40 

0.70 

1.01 

-0.23 

22370 

D 

0 

4 

9 

-0.30 

0.54 

0.38 

-0.35 

22371 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22371 

A 

1 

38 

84 

1.69 

0.24 

1.09 

0.29 

22371 

B 

0 

2 

4 

0.89 

2.11 

4.69 

-0.09 

22371 

C 

0 

3 

7 

0.73 

0.79 

1.51 

-0.13 

22371 

D 

0 

2 

4 

-0.38 

0.84 

0.43 

-0.27 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22372 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22372 

A 

1 

39 

87 

2.00 

0.25 

0.85 

0.47 

22372 

B 

0 

3 

7 

-0.03 

0.67 

0.66 

-0.27 

22372 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22372 

D 

0 

3 

7 

-0.64 

0.89 

0.39 

-0.37 

22373 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

0.00 

22373 

A 

1 

26 

57 

2.19 

0.16 

0.68 

0.65 

22373 

B 

0 

11 

24 

0.39 

0.29 

0.47 

-0.60 

22373 

C 

0 

5 

11 

1.15 

0.21 

0.75 

-0.14 

22373 

D 

0 

4 

9 

1.26 

0.27 

0.86 

-0.09 

22374 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

22374 

A 

1 

30 

68 

1.93 

0.21 

0.98 

0.54 

22374 

B 

0 

1 

2 

0.35 

0.00 

0.44 

-0.13 

22374 

C 

0 

6 

14 

0.79 

0.33 

0.88 

-0.21 

22374 

D 

0 

7 

16 

0.15 

0.41 

0.66 

-0.44 

22375 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

22375 

A 

1 

34 

74 

2.22 

0.25 

0.69 

0.59 

22375 

B 

0 

3 

7 

0.47 

0.65 

0.81 

-0.20 

22375 

C 

0 

6 

13 

-0.20 

0.25 

0.35 

-0.45 

22375 

D 

0 

3 

7 

0.19 

0.37 

0.49 

-0.24 

22376 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22376 

A 

1 

32 

71 

1.88 

0.21 

0.99 

0.63 

22376 

B 

0 

2 

4 

0.02 

0.66 

0.50 

-0.18 

22376 

C 

0 

5 

11 

-0.66 

0.52 

0.31 

-0.47 

22376 

D 

0 

6 

13 

0.15 

0.48 

0.90 

-0.30 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22377 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

22377 

A 

1 

35 

80 

1.60 

0.19 

0.61 

0.70 

22377 

B 

0 

3 

7 

-0.56 

0.41 

0.38 

-0.31 

22377 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22377 

D 

0 

6 

14 

-1.09 

0.28 

0.22 

-0.59 

22378 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22378 

A 

1 

38 

84 

1.91 

0.22 

0.83 

0.50 

22378 

B 

0 

2 

4 

-1.02 

0.32 

0.14 

-0.39 

22378 

C 

0 

2 

4 

0.54 

0.54 

0.73 

-0.16 

22378 

D 

0 

3 

7 

0.18 

0.39 

0.52 

-0.26 

22379 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22379 

A 

1 

35 

78 

1.54 

0.20 

0.84 

0.47 

22379 

B 

0 

2 

4 

1.75 

0.09 

2.61 

0.09 

22379 

C 

0 

1 

2 

0.30 

0.00 

0.61 

-0.10 

22379 

D 

0 

7 

16 

-0.54 

0.45 

0.41 

-0.55 

22380 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22380 

A 

1 

30 

67 

2.01 

0.25 

1.03 

0.40 

22380 

B 

0 

10 

22 

1.12 

0.33 

1.36 

-0.20 

22380 

C 

0 

2 

4 

0.87 

0.52 

0.72 

-0.12 

22380 

D 

0 

3 

7 

0.03 

0.51 

0.37 

-0.32 

22381 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

22381 

A 

1 

38 

88 

1.69 

0.23 

0.85 

0.45 

22381 

B 

0 

2 

5 

0.17 

1.14 

1.11 

-0.18 

22381 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22381 

D 

0 

3 

7 

-0.94 

0.89 

0.46 

-0.42 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22382 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.05 

22382 

A 

1 

21 

47 

1.35 

0.24 

1.27 

0.33 

22382 

B 

0 

9 

20 

0.94 

0.37 

1.54 

0.02 

22382 

C 

0 

5 

11 

0.22 

0.99 

2.41 

-0.19 

22382 

D 

0 

10 

22 

0.25 

0.28 

0.68 

-0.27 

22383 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22383 

A 

1 

32 

71 

1.88 

0.19 

0.86 

0.57 

22383 

B 

0 

5 

11 

0.82 

0.37 

0.87 

-0.19 

22383 

C 

0 

5 

11 

0.05 

0.36 

0.42 

-0.42 

22383 

D 

0 

3 

7 

0.29 

0.28 

0.44 

-0.26 

22384 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22384 

A 

1 

32 

71 

1.68 

0.24 

1.01 

0.35 

22384 

B 

0 

4 

9 

0.69 

0.82 

1.54 

-0.14 

22384 

C 

0 

6 

13 

1.00 

0.46 

1.41 

-0.09 

22384 

D 

0 

3 

7 

-0.70 

1.41 

0.96 

-0.36 

22385 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

22385 

A 

1 

30 

67 

1.58 

0.28 

0.91 

0.49 

22385 

B 

0 

6 

13 

-0.41 

0.65 

0.71 

-0.35 

22385 

C 

0 

6 

13 

0.15 

0.45 

0.91 

-0.21 

22385 

D 

0 

3 

7 

0.02 

0.64 

0.75 

-0.17 

22386 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22386 

A 

1 

30 

67 

1.76 

0.20 

1.02 

0.43 

22386 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

22386 

C 

0 

9 

20 

1.08 

0.33 

1.81 

-0.11 

22386 

D 

0 

6 

13 

-0.13 

0.59 

0.46 

-0.46 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22387 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22387 

A 

1 

23 

51 

2.28 

0.22 

0.61 

0.64 

22387 

B 

0 

5 

11 

1.43 

0.27 

1.21 

-0.01 

22387 

C 

0 

7 

16 

0.28 

0.43 

0.56 

-0.38 

22387 

D 

0 

10 

22 

0.40 

0.31 

0.52 

-0.43 

22388 

* 

-1 

1483 

37 

1.64 

0.03 

0.00 

0.07 

22388 

A 

1 

1418 

57 

2.17 

0.04 

1.00 

0.55 

22388 

B 

0 

331 

13 

0.57 

0.06 

0.98 

-0.22 

22388 

C 

0 

239 

10 

0.51 

0.07 

0.89 

-0.20 

22388 

D 

0 

521 

21 

0.43 

0.05 

0.76 

-0.34 

22389 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22389 

A 

1 

29 

64 

2.21 

0.24 

0.88 

0.50 

22389 

B 

0 

4 

9 

0.69 

0.66 

0.85 

-0.21 

22389 

C 

0 

4 

9 

0.86 

0.36 

0.70 

-0.18 

22389 

D 

0 

8 

18 

0.62 

0.54 

1.25 

-0.34 

22390 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

22390 

A 

1 

23 

50 

1.71 

0.27 

1.00 

0.46 

22390 

B 

0 

6 

13 

0.35 

0.36 

0.65 

-0.28 

22390 

C 

0 

6 

13 

0.76 

0.22 

0.83 

-0.14 

22390 

D 

0 

11 

24 

0.75 

0.21 

0.89 

-0.21 

22391 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

22391 

A 

1 

29 

64 

1.76 

0.22 

1.19 

0.46 

22391 

B 

0 

6 

13 

0.86 

0.20 

0.86 

-0.12 

22391 

C 

0 

5 

11 

0.26 

0.64 

1.11 

-0.26 

22391 

D 

0 

5 

11 

0.04 

0.98 

0.81 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22392 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

22392 

A 

1 

22 

49 

2.40 

0.31 

0.94 

0.52 

22392 

B 

0 

12 

27 

1.39 

0.36 

1.57 

-0.09 

22392 

C 

0 

4 

9 

0.26 

0.51 

0.40 

-0.28 

22392 

D 

0 

7 

16 

0.30 

0.27 

0.39 

-0.38 

22393 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

22393 

A 

1 

30 

65 

1.90 

0.25 

0.81 

0.60 

22393 

B 

0 

6 

13 

0.38 

0.62 

1.58 

-0.15 

22393 

C 

0 

1 

2 

-0.08 

0.00 

0.40 

-0.10 

22393 

D 

0 

9 

20 

-0.96 

0.57 

0.39 

-0.56 

22394 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

22394 

A 

1 

35 

76 

2.14 

0.25 

1.12 

0.40 

22394 

B 

0 

1 

2 

-2.03 

0.00 

0.04 

-0.37 

22394 

C 

0 

3 

7 

0.51 

0.02 

0.46 

-0.22 

22394 

D 

0 

7 

15 

1.17 

0.42 

1.42 

-0.18 

22395 

* 

-1 

3945 

99 

1.52 

0.02 

0.00 

0.01 

22395 

A 

1 

20 

43 

2.45 

0.25 

0.69 

0.65 

22395 

B 

0 

8 

17 

0.82 

0.32 

0.76 

-0.19 

22395 

C 

0 

7 

15 

0.29 

0.46 

0.55 

-0.34 

22395 

D 

0 

12 

26 

0.71 

0.30 

0.73 

-0.29 

22396 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

22396 

A 

1 

32 

73 

2.06 

0.25 

1.10 

0.44 

22396 

B 

0 

2 

5 

-0.27 

0.27 

0.24 

-0.29 

22396 

C 

0 

5 

11 

1.74 

0.19 

1.87 

0.02 

22396 

D 

0 

5 

11 

-0.12 

0.35 

0.33 

-0.44 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

22397 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

22397 

A 

1 

19 

42 

2.09 

0.36 

2.61 

0.41 

22397 

B 

0 

7 

16 

0.83 

0.43 

0.86 

-0.15 

22397 

C 

0 

13 

29 

1.16 

0.37 

1.35 

-0.09 

22397 

D 

0 

6 

13 

0.14 

0.56 

0.42 

-0.32 

22398 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

22398 

A 

1 

29 

64 

1.94 

0.22 

0.96 

0.43 

22398 

B 

0 

7 

16 

0.56 

0.63 

1.66 

-0.30 

22398 

C 

0 

3 

7 

1.60 

0.38 

1.68 

0.02 

22398 

D 

0 

6 

13 

0.47 

0.42 

0.68 

-0.30 

22399 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

22399 

A 

1 

30 

67 

1.58 

0.27 

1.55 

0.42 

22399 

B 

0 

3 

7 

-0.15 

0.83 

0.71 

-0.22 

22399 

C 

0 

9 

20 

1.00 

0.17 

1.25 

-0.04 

22399 

D 

0 

3 

7 

-1.90 

0.48 

0.08 

-0.52 

22400 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.03 

22400 

A 

1 

26 

59 

2.17 

0.27 

1.73 

0.21 

22400 

B 

0 

6 

14 

1.86 

0.79 

4.26 

-0.02 

22400 

C 

0 

9 

20 

1.54 

0.40 

1.65 

-0.14 

22400 

D 

0 

3 

7 

1.11 

0.29 

0.58 

-0.16 

23001 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23001 

A 

1 

43 

96 

1.71 

0.29 

0.93 

0.38 

23001 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23001 

C 

0 

1 

2 

-1.36 

0.00 

0.29 

-0.22 

23001 

D 

0 

1 

2 

-2.57 

0.00 

0.09 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23002 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.03 

23002 

A 

-1 

44 

100 

1.90 

0.24 

0.00 

0.00 

23002 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

23002 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

23002 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

23003 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23003 

A 

1 

42 

95 

1.52 

0.18 

0.56 

0.58 

23003 

B 

0 

1 

2 

-1.07 

0.00 

0.25 

-0.25 

23003 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23003 

D 

0 

1 

2 

-4.02 

0.00 

0.01 

-0.56 

23004 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23004 

A 

1 

42 

95 

1.45 

0.20 

1.02 

0.20 

23004 

B 

0 

1 

2 

1.15 

0.00 

1.55 

-0.03 

23004 

C 

0 

1 

2 

-0.75 

0.00 

0.23 

-0.25 

23004 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23005 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23005 

A 

1 

42 

93 

1.79 

0.24 

1.08 

0.12 

23005 

B 

0 

2 

4 

1.74 

0.75 

2.99 

0.00 

23005 

C 

0 

1 

2 

-0.24 

0.00 

0.32 

-0.20 

23005 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23006 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

23006 

A 

1 

42 

91 

1.92 

0.26 

1.49 

0.27 

23006 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23006 

C 

0 

3 

7 

0.60 

0.16 

0.85 

-0.19 

23006 

D 

0 

1 

2 

-0.44 

0.00 

0.29 

-0.20 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23007 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23007 

A 

1 

38 

86 

1.60 

0.20 

0.86 

0.45 

23007 

B 

0 

1 

2 

0.32 

0.00 

0.61 

-0.12 

23007 

C 

0 

5 

11 

-0.26 

0.54 

0.54 

-0.44 

23007 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23008 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23008 

A 

1 

43 

96 

1.43 

0.24 

0.98 

0.32 

23008 

B 

0 

1 

2 

-1.13 

0.00 

0.25 

-0.23 

23008 

C 

0 

1 

2 

-1.04 

0.00 

0.27 

-0.22 

23008 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23009 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23009 

A 

1 

39 

89 

1.51 

0.24 

1.01 

0.35 

23009 

B 

0 

1 

2 

-0.81 

0.00 

0.26 

-0.21 

23009 

C 

0 

3 

7 

-0.23 

0.98 

0.96 

-0.27 

23009 

D 

0 

1 

2 

0.64 

0.00 

1.11 

-0.07 

23010 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

23010 

A 

1 

42 

95 

1.62 

0.20 

0.97 

0.33 

23010 

B 

0 

1 

2 

-1.33 

0.00 

0.13 

-0.32 

23010 

C 

0 

1 

2 

0.28 

0.00 

0.66 

-0.14 

23010 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23011 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23011 

A 

1 

42 

93 

1.46 

0.22 

0.96 

0.28 

23011 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23011 

C 

0 

1 

2 

-0.19 

0.00 

0.48 

-0.16 

23011 

D 

0 

2 

4 

-0.17 

1.48 

1.14 

-0.22 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23012 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23012 

A 

1 

44 

98 

1.89 

0.26 

0.42 

0.48 

23012 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23012 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23012 

D 

0 

1 

2 

-4.30 

0.00 

0.02 

-0.48 

23013 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23013 

A 

1 

43 

96 

1.47 

0.23 

0.55 

0.53 

23013 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23013 

C 

0 

1 

2 

-1.00 

0.00 

0.41 

-0.19 

23013 

D 

0 

1 

2 

-5.44 

0.00 

0.00 

-0.56 

23014 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

23014 

A 

1 

44 

98 

1.98 

0.23 

1.05 

0.11 

23014 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23014 

C 

0 

1 

2 

0.82 

0.00 

0.86 

-0.11 

23014 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23015 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23015 

A 

1 

43 

96 

1.61 

0.22 

0.90 

0.35 

23015 

B 

0 

1 

2 

-1.05 

0.00 

0.19 

-0.25 

23015 

C 

0 

1 

2 

-0.88 

0.00 

0.23 

-0.24 

23015 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23016 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23016 

A 

1 

41 

91 

1.55 

0.18 

0.73 

0.47 

23016 

B 

0 

1 

2 

-0.36 

0.00 

0.37 

-0.19 

23016 

C 

0 

1 

2 

1.74 

0.00 

3.01 

0.04 

23016 

D 

0 

2 

4 

-2.14 

0.27 

0.06 

-0.55 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23017 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

23017 

A 

1 

38 

83 

1.15 

0.23 

1.28 

-0.01 

23017 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23017 

C 

0 

7 

15 

1.13 

0.23 

1.83 

-0.01 

23017 

D 

0 

1 

2 

1.53 

0.00 

2.35 

0.04 

23018 

* 

-1 

3941 

99 

1.51 

0.02 

0.00 

-0.05 

23018 

A 

1 

46 

90 

2.31 

0.24 

1.04 

0.35 

23018 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23018 

C 

0 

4 

8 

0.63 

0.42 

0.78 

-0.26 

23018 

D 

0 

1 

2 

-0.64 

0.00 

0.17 

-0.24 

23019 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23019 

A 

1 

40 

89 

1.73 

0.19 

0.85 

0.48 

23019 

B 

0 

4 

9 

-0.40 

0.69 

0.63 

-0.45 

23019 

C 

0 

1 

2 

0.02 

0.00 

0.43 

-0.17 

23019 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23020 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23020 

A 

1 

41 

91 

1.38 

0.23 

1.05 

0.23 

23020 

B 

0 

3 

7 

0.21 

0.56 

0.90 

-0.19 

23020 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23020 

D 

0 

1 

2 

0.24 

0.00 

0.73 

-0.11 

23021 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23021 

A 

1 

31 

70 

1.69 

0.34 

1.83 

0.26 

23021 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23021 

C 

0 

10 

23 

1.27 

0.34 

2.49 

-0.03 

23021 

D 

0 

3 

7 

-1.73 

1.91 

0.42 

-0.43 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23022 

* 

-1 

3757 

94 

1.52 

0.02 

0.00 

0.03 

23022 

A 

1 

161 

69 

1.61 

0.09 

1.26 

0.30 

23022 

B 

0 

61 

26 

0.88 

0.13 

1.12 

-0.24 

23022 

C 

0 

12 

5 

0.59 

0.25 

0.80 

-0.15 

23022 

D 

0 

1 

0 

1.50 

0.00 

1.43 

0.01 

23023 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.00 

23023 

A 

1 

29 

67 

1.83 

0.25 

1.27 

0.43 

23023 

B 

0 

3 

7 

0.82 

0.41 

0.79 

-0.14 

23023 

C 

0 

8 

19 

0.54 

0.18 

0.58 

-0.35 

23023 

D 

0 

3 

7 

0.87 

0.50 

0.93 

-0.13 

23024 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

23024 

A 

1 

30 

67 

1.50 

0.21 

1.01 

0.46 

23024 

B 

0 

4 

9 

0.96 

0.50 

1.40 

-0.04 

23024 

C 

0 

7 

16 

0.13 

0.29 

0.59 

-0.36 

23024 

D 

0 

4 

9 

0.17 

0.47 

0.67 

-0.26 

23025 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

23025 

A 

1 

29 

63 

1.51 

0.27 

1.18 

0.43 

23025 

B 

0 

1 

2 

-0.80 

0.00 

0.21 

-0.20 

23025 

C 

0 

10 

22 

0.53 

0.29 

1.11 

-0.20 

23025 

D 

0 

6 

13 

0.00 

0.36 

0.61 

-0.29 

23026 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

0.00 

23026 

A 

1 

30 

65 

2.09 

0.28 

0.95 

0.48 

23026 

B 

0 

1 

2 

-0.24 

0.00 

0.26 

-0.18 

23026 

C 

0 

12 

26 

0.78 

0.29 

1.16 

-0.30 

23026 

D 

0 

3 

7 

-0.04 

0.36 

0.36 

-0.28 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23027 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

23027 

A 

1 

23 

50 

1.66 

0.37 

2.01 

0.28 

23027 

B 

0 

2 

4 

1.10 

0.87 

1.34 

-0.02 

23027 

C 

0 

14 

30 

0.99 

0.32 

1.50 

-0.12 

23027 

D 

0 

7 

15 

0.47 

0.28 

0.61 

-0.22 

23028 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23028 

A 

1 

28 

62 

1.64 

0.27 

1.48 

0.28 

23028 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23028 

C 

0 

9 

20 

1.38 

0.19 

1.45 

0.01 

23028 

D 

0 

8 

18 

0.37 

0.30 

0.65 

-0.36 

23029 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23029 

A 

1 

24 

53 

2.09 

0.29 

1.15 

0.52 

23029 

B 

0 

5 

11 

0.24 

0.40 

0.51 

-0.26 

23029 

C 

0 

13 

29 

0.77 

0.34 

1.50 

-0.25 

23029 

D 

0 

3 

7 

-0.10 

0.72 

0.39 

-0.26 

23030 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23030 

A 

1 

31 

69 

2.01 

0.24 

1.18 

0.36 

23030 

B 

0 

4 

9 

0.28 

0.25 

0.36 

-0.36 

23030 

C 

0 

8 

18 

1.30 

0.25 

1.11 

-0.15 

23030 

D 

0 

2 

4 

1.51 

0.40 

1.22 

-0.03 

23031 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23031 

A 

1 

41 

91 

1.37 

0.22 

0.90 

0.36 

23031 

B 

0 

3 

7 

-0.08 

1.01 

1.27 

-0.22 

23031 

C 

0 

1 

2 

-2.04 

0.00 

0.09 

-0.32 

23031 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23032 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

23032 

A 

1 

1 

2 

-0.28 

0.00 

10.11 

-0.13 

23032 

B 

0 

36 

78 

1.44 

0.19 

1.09 

0.33 

23032 

C 

0 

3 

7 

1.85 

0.86 

1.77 

0.11 

23032 

D 

0 

6 

13 

-0.65 

1.23 

0.60 

-0.43 

23033 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

23033 

A 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

23033 

B 

-1 

37 

80 

1.77 

0.21 

0.00 

0.44 

23033 

C 

-1 

5 

11 

-0.23 

0.58 

0.00 

-0.43 

23033 

D 

-1 

4 

9 

0.80 

0.69 

0.00 

-0.15 

23034 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

23034 

A 

1 

36 

80 

1.98 

0.27 

0.97 

0.45 

23034 

B 

0 

1 

2 

-0.14 

0.00 

0.33 

-0.14 

23034 

C 

0 

3 

7 

-0.24 

0.78 

0.47 

-0.27 

23034 

D 

0 

5 

11 

0.12 

1.03 

2.08 

-0.29 

23035 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23035 

A 

1 

38 

84 

1.99 

0.22 

1.38 

0.30 

23035 

B 

0 

1 

2 

0.21 

0.00 

0.36 

-0.18 

23035 

C 

0 

3 

7 

1.72 

0.21 

1.70 

-0.02 

23035 

D 

0 

3 

7 

0.19 

0.72 

0.51 

-0.32 

23036 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23036 

A 

1 

31 

69 

2.13 

0.24 

0.90 

0.53 

23036 

B 

0 

4 

9 

0.32 

0.87 

1.44 

-0.27 

23036 

C 

0 

7 

16 

0.73 

0.43 

0.93 

-0.25 

23036 

D 

0 

3 

7 

-0.18 

0.40 

0.29 

-0.32 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23037 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23037 

A 

1 

36 

80 

1.81 

0.18 

0.71 

0.59 

23037 

B 

0 

2 

4 

0.14 

1.12 

0.75 

-0.17 

23037 

C 

0 

4 

9 

0.19 

0.33 

0.53 

-0.23 

23037 

D 

0 

3 

7 

-1.84 

1.86 

0.33 

-0.54 

23038 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23038 

A 

1 

36 

78 

1.91 

0.21 

0.74 

0.56 

23038 

B 

0 

1 

2 

-0.13 

0.00 

0.37 

-0.14 

23038 

C 

0 

4 

9 

-0.80 

0.85 

0.59 

-0.41 

23038 

D 

0 

5 

11 

-0.10 

1.07 

1.69 

-0.31 

23039 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

23039 

A 

1 

36 

78 

1.87 

0.17 

0.87 

0.52 

23039 

B 

0 

3 

7 

1.01 

0.83 

1.66 

-0.11 

23039 

C 

0 

6 

13 

0.00 

0.53 

0.64 

-0.47 

23039 

D 

0 

1 

2 

-0.35 

0.00 

0.23 

-0.22 

23040 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23040 

A 

1 

40 

89 

1.95 

0.24 

1.13 

0.28 

23040 

B 

0 

4 

9 

0.65 

0.78 

1.51 

-0.23 

23040 

C 

0 

1 

2 

0.42 

0.00 

0.54 

-0.14 

23040 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23041 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23041 

A 

1 

32 

73 

1.82 

0.24 

1.30 

0.44 

23041 

B 

0 

5 

11 

0.09 

0.38 

0.52 

-0.34 

23041 

C 

0 

4 

9 

1.36 

0.47 

1.89 

-0.02 

23041 

D 

0 

3 

7 

-0.27 

0.46 

0.33 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23042 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23042 

A 

1 

39 

89 

1.46 

0.25 

1.09 

0.31 

23042 

B 

0 

2 

5 

-2.09 

1.02 

0.14 

-0.43 

23042 

C 

0 

2 

5 

0.29 

0.47 

1.07 

-0.13 

23042 

D 

0 

1 

2 

2.52 

0.00 

8.98 

0.11 

23043 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23043 

A 

1 

36 

80 

1.97 

0.22 

1.02 

0.29 

23043 

B 

0 

8 

18 

1.07 

0.53 

2.32 

-0.23 

23043 

C 

0 

1 

2 

0.07 

0.00 

0.31 

-0.19 

23043 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23044 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23044 

A 

1 

41 

89 

1.87 

0.24 

1.30 

0.32 

23044 

B 

0 

3 

7 

0.77 

0.44 

1.07 

-0.16 

23044 

C 

0 

2 

4 

-0.38 

0.45 

0.30 

-0.29 

23044 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23045 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

23045 

A 

1 

36 

82 

1.90 

0.25 

0.94 

0.42 

23045 

B 

0 

5 

11 

0.10 

0.46 

0.67 

-0.34 

23045 

C 

0 

2 

5 

0.38 

1.20 

1.07 

-0.17 

23045 

D 

0 

1 

2 

0.41 

0.00 

0.61 

-0.12 

23046 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

23046 

A 

1 

37 

82 

2.09 

0.21 

1.12 

0.32 

23046 

B 

0 

3 

7 

1.29 

0.24 

0.95 

-0.12 

23046 

C 

0 

3 

7 

1.16 

0.75 

1.29 

-0.15 

23046 

D 

0 

2 

4 

0.33 

1.22 

0.63 

-0.26 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23047 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

23047 

A 

1 

39 

85 

1.56 

0.22 

1.22 

0.38 

23047 

B 

0 

2 

4 

0.74 

0.02 

1.04 

-0.07 

23047 

C 

0 

2 

4 

-0.06 

0.87 

0.65 

-0.17 

23047 

D 

0 

3 

7 

-0.92 

2.47 

3.69 

-0.35 

23048 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23048 

A 

1 

41 

93 

1.43 

0.21 

0.97 

0.07 

23048 

B 

0 

2 

5 

0.47 

2.26 

4.05 

-0.15 

23048 

C 

0 

1 

2 

2.16 

0.00 

4.54 

0.08 

23048 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23049 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.02 

23049 

A 

1 

41 

93 

1.77 

0.27 

1.64 

0.03 

23049 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23049 

C 

0 

2 

5 

1.83 

0.92 

4.18 

0.01 

23049 

D 

0 

1 

2 

0.98 

0.00 

1.23 

-0.07 

23050 

* 

-1 

3759 

94 

1.52 

0.02 

0.00 

0.02 

23050 

A 

1 

205 

88 

1.50 

0.08 

1.04 

0.26 

23050 

B 

0 

7 

3 

0.63 

0.46 

1.32 

-0.12 

23050 

C 

0 

19 

8 

0.66 

0.21 

1.04 

-0.20 

23050 

D 

0 

2 

1 

-0.04 

0.85 

0.49 

-0.12 

23051 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

0.00 

23051 

A 

1 

32 

70 

1.87 

0.22 

1.27 

0.39 

23051 

B 

0 

1 

2 

0.12 

0.00 

0.30 

-0.18 

23051 

C 

0 

9 

20 

1.15 

0.23 

1.02 

-0.17 

23051 

D 

0 

4 

9 

0.37 

0.64 

0.56 

-0.30 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23052 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.04 

23052 

A 

1 

36 

82 

2.34 

0.19 

0.90 

0.39 

23052 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23052 

C 

0 

5 

11 

1.12 

0.61 

1.00 

-0.29 

23052 

D 

0 

3 

7 

1.05 

0.56 

0.67 

-0.24 

23053 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

23053 

A 

1 

31 

69 

1.45 

0.22 

0.98 

0.47 

23053 

B 

0 

5 

11 

0.47 

0.44 

0.97 

-0.16 

23053 

C 

0 

7 

16 

0.03 

0.38 

0.69 

-0.35 

23053 

D 

0 

2 

4 

0.00 

0.28 

0.47 

-0.18 

23054 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23054 

A 

1 

37 

82 

2.03 

0.24 

1.01 

0.39 

23054 

B 

0 

1 

2 

1.36 

0.00 

1.26 

-0.04 

23054 

C 

0 

5 

11 

0.47 

0.30 

0.60 

-0.31 

23054 

D 

0 

2 

4 

0.24 

0.01 

0.41 

-0.22 

23055 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23055 

A 

1 

36 

80 

1.64 

0.27 

1.45 

0.37 

23055 

B 

0 

2 

4 

-1.27 

0.16 

0.15 

-0.33 

23055 

C 

0 

5 

11 

0.39 

0.78 

1.87 

-0.20 

23055 

D 

0 

2 

4 

0.71 

0.37 

1.14 

-0.08 

23056 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23056 

A 

1 

34 

76 

1.86 

0.30 

1.02 

0.38 

23056 

B 

0 

2 

4 

0.26 

0.37 

0.58 

-0.16 

23056 

C 

0 

4 

9 

0.89 

0.59 

1.76 

-0.11 

23056 

D 

0 

5 

11 

0.03 

0.18 

0.46 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23057 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23057 

A 

1 

36 

82 

1.79 

0.17 

0.73 

0.61 

23057 

B 

0 

2 

5 

-0.79 

0.52 

0.19 

-0.38 

23057 

C 

0 

5 

11 

0.19 

0.54 

0.88 

-0.35 

23057 

D 

0 

1 

2 

-1.06 

0.00 

0.13 

-0.30 

23058 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23058 

A 

1 

32 

73 

1.74 

0.26 

1.01 

0.48 

23058 

B 

0 

3 

7 

-0.92 

0.13 

0.20 

-0.37 

23058 

C 

0 

8 

18 

0.40 

0.53 

1.79 

-0.26 

23058 

D 

0 

1 

2 

-0.15 

0.00 

0.41 

-0.14 

23059 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23059 

A 

1 

31 

67 

1.88 

0.28 

1.14 

0.42 

23059 

B 

0 

2 

4 

-1.03 

0.01 

0.13 

-0.32 

23059 

C 

0 

12 

26 

0.84 

0.36 

1.47 

-0.20 

23059 

D 

0 

1 

2 

-1.74 

0.00 

0.06 

-0.29 

23060 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23060 

A 

1 

30 

68 

1.59 

0.22 

1.02 

0.40 

23060 

B 

0 

3 

7 

0.69 

0.44 

0.91 

-0.10 

23060 

C 

0 

7 

16 

1.01 

0.49 

2.10 

-0.06 

23060 

D 

0 

4 

9 

-0.98 

1.00 

0.35 

-0.49 

23061 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23061 

A 

1 

36 

78 

2.02 

0.24 

1.02 

0.45 

23061 

B 

0 

1 

2 

1.27 

0.00 

1.21 

-0.04 

23061 

C 

0 

7 

15 

0.59 

0.41 

0.93 

-0.31 

23061 

D 

0 

2 

4 

-0.67 

0.02 

0.17 

-0.34 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23062 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23062 

A 

1 

35 

78 

1.63 

0.25 

1.57 

0.33 

23062 

B 

0 

4 

9 

-0.23 

0.54 

0.55 

-0.33 

23062 

C 

0 

5 

11 

1.23 

0.54 

2.35 

-0.03 

23062 

D 

0 

1 

2 

-0.91 

0.00 

0.17 

-0.23 

23063 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23063 

A 

1 

35 

78 

1.73 

0.26 

0.97 

0.50 

23063 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23063 

C 

0 

7 

16 

-0.23 

0.34 

0.64 

-0.40 

23063 

D 

0 

3 

7 

-0.22 

1.01 

0.98 

-0.25 

23064 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

23064 

A 

1 

34 

74 

2.00 

0.23 

1.28 

0.30 

23064 

B 

0 

1 

2 

0.90 

0.00 

0.66 

-0.09 

23064 

C 

0 

8 

17 

1.37 

0.44 

2.25 

-0.13 

23064 

D 

0 

3 

7 

0.33 

0.88 

0.65 

-0.27 

23065 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23065 

A 

1 

34 

76 

1.83 

0.25 

0.98 

0.45 

23065 

B 

0 

1 

2 

1.11 

0.00 

1.17 

-0.04 

23065 

C 

0 

7 

16 

0.21 

0.30 

0.60 

-0.37 

23065 

D 

0 

3 

7 

0.28 

0.59 

0.71 

-0.22 

23066 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23066 

A 

1 

34 

74 

1.99 

0.25 

1.19 

0.36 

23066 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23066 

C 

0 

7 

15 

0.44 

0.70 

1.23 

-0.34 

23066 

D 

0 

5 

11 

1.13 

0.41 

1.18 

-0.12 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23067 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23067 

A 

1 

24 

55 

1.88 

0.32 

1.43 

0.37 

23067 

B 

0 

2 

5 

-1.66 

0.49 

0.06 

-0.41 

23067 

C 

0 

14 

32 

0.94 

0.34 

1.35 

-0.17 

23067 

D 

0 

4 

9 

1.03 

0.57 

1.34 

-0.06 

23068 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.05 

23068 

A 

1 

27 

60 

1.31 

0.27 

1.46 

0.36 

23068 

B 

0 

3 

7 

0.24 

0.52 

0.80 

-0.12 

23068 

C 

0 

12 

27 

0.51 

0.41 

1.82 

-0.16 

23068 

D 

0 

3 

7 

-0.74 

0.40 

0.28 

-0.30 

23069 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

23069 

A 

1 

36 

82 

1.96 

0.27 

1.86 

0.36 

23069 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23069 

C 

0 

4 

9 

-0.61 

0.62 

0.38 

-0.44 

23069 

D 

0 

4 

9 

1.46 

0.29 

1.68 

-0.04 

23070 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

23070 

A 

1 

34 

77 

1.98 

0.29 

1.12 

0.35 

23070 

B 

0 

3 

7 

0.90 

0.06 

0.90 

-0.13 

23070 

C 

0 

6 

14 

0.42 

0.48 

0.92 

-0.30 

23070 

D 

0 

1 

2 

0.72 

0.00 

0.75 

-0.09 

23071 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23071 

A 

1 

30 

68 

1.69 

0.28 

1.12 

0.41 

23071 

B 

0 

4 

9 

-0.06 

0.42 

0.47 

-0.28 

23071 

C 

0 

7 

16 

0.81 

0.41 

1.54 

-0.13 

23071 

D 

0 

3 

7 

-0.18 

0.82 

0.63 

-0.26 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23072 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23072 

A 

1 

31 

70 

1.67 

0.21 

0.90 

0.54 

23072 

B 

0 

3 

7 

-0.28 

0.50 

0.38 

-0.33 

23072 

C 

0 

8 

18 

0.40 

0.27 

0.75 

-0.32 

23072 

D 

0 

2 

5 

0.15 

0.68 

0.56 

-0.19 

23073 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

23073 

A 

1 

36 

78 

1.77 

0.22 

1.10 

0.39 

23073 

B 

0 

5 

11 

0.87 

0.41 

1.18 

-0.16 

23073 

C 

0 

2 

4 

0.68 

0.06 

0.69 

-0.13 

23073 

D 

0 

3 

7 

-0.22 

1.04 

0.77 

-0.34 

23074 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23074 

A 

1 

32 

71 

1.68 

0.25 

1.06 

0.43 

23074 

B 

0 

2 

4 

-0.54 

0.04 

0.23 

-0.28 

23074 

C 

0 

8 

18 

0.47 

0.33 

0.90 

-0.27 

23074 

D 

0 

3 

7 

0.60 

0.70 

1.21 

-0.13 

23075 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23075 

A 

1 

40 

89 

1.76 

0.24 

1.99 

0.21 

23075 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23075 

C 

0 

4 

9 

0.91 

0.33 

1.14 

-0.16 

23075 

D 

0 

1 

2 

0.19 

0.00 

0.47 

-0.15 

23076 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

23076 

A 

1 

29 

66 

1.55 

0.23 

1.00 

0.41 

23076 

B 

0 

5 

11 

0.77 

0.77 

2.04 

-0.10 

23076 

C 

0 

6 

14 

0.49 

0.24 

0.81 

-0.20 

23076 

D 

0 

4 

9 

-0.20 

0.55 

0.52 

-0.33 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23077 

* 

-1 

3950 

99 

1.51 

0.02 

0.00 

-0.02 

23077 

A 

1 

26 

62 

2.23 

0.38 

1.46 

0.36 

23077 

B 

0 

7 

17 

1.61 

0.40 

2.67 

-0.03 

23077 

C 

0 

4 

10 

0.86 

0.47 

0.92 

-0.17 

23077 

D 

0 

5 

12 

0.11 

0.22 

0.35 

-0.35 

23078 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

23078 

A 

1 

27 

60 

2.02 

0.27 

1.18 

0.39 

23078 

B 

0 

9 

20 

1.38 

0.40 

1.67 

-0.07 

23078 

C 

0 

2 

4 

0.13 

0.38 

0.31 

-0.22 

23078 

D 

0 

7 

16 

0.47 

0.46 

0.58 

-0.33 

23079 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

23079 

A 

1 

23 

50 

1.70 

0.32 

1.30 

0.41 

23079 

B 

0 

15 

33 

0.39 

0.27 

0.93 

-0.36 

23079 

C 

0 

3 

7 

0.85 

0.60 

1.12 

-0.05 

23079 

D 

0 

5 

11 

0.84 

0.57 

1.43 

-0.07 

23080 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23080 

A 

1 

23 

51 

1.63 

0.32 

1.86 

0.22 

23080 

B 

0 

15 

33 

1.15 

0.22 

1.15 

-0.13 

23080 

C 

0 

4 

9 

0.91 

0.34 

0.81 

-0.12 

23080 

D 

0 

3 

7 

1.10 

0.37 

0.97 

-0.06 

23081 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.03 

23081 

A 

1 

25 

54 

2.48 

0.27 

0.97 

0.48 

23081 

B 

0 

13 

28 

1.07 

0.27 

0.82 

-0.37 

23081 

C 

0 

3 

7 

0.90 

0.91 

1.06 

-0.19 

23081 

D 

0 

5 

11 

1.58 

0.46 

1.33 

-0.08 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23082 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.04 

23082 

A 

1 

30 

65 

2.52 

0.27 

1.03 

0.42 

23082 

B 

0 

8 

17 

1.57 

0.38 

1.41 

-0.17 

23082 

C 

0 

5 

11 

1.07 

0.40 

0.74 

-0.25 

23082 

D 

0 

3 

7 

0.77 

0.34 

0.44 

-0.24 

23083 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23083 

A 

1 

27 

61 

1.48 

0.28 

2.12 

0.21 

23083 

B 

0 

7 

16 

0.61 

0.45 

0.95 

-0.22 

23083 

C 

0 

6 

14 

0.97 

0.35 

1.12 

-0.09 

23083 

D 

0 

4 

9 

1.39 

0.13 

1.35 

0.03 

23084 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23084 

A 

1 

32 

73 

1.75 

0.23 

0.94 

0.39 

23084 

B 

0 

7 

16 

0.94 

0.73 

4.42 

-0.11 

23084 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23084 

D 

0 

5 

11 

-0.58 

1.06 

1.28 

-0.42 

23085 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

23085 

A 

1 

33 

72 

2.23 

0.22 

1.09 

0.48 

23085 

B 

0 

7 

15 

1.04 

0.40 

1.24 

-0.25 

23085 

C 

0 

4 

9 

0.27 

0.35 

0.36 

-0.36 

23085 

D 

0 

2 

4 

1.03 

0.47 

0.75 

-0.13 

23086 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23086 

A 

1 

30 

67 

1.85 

0.29 

1.68 

0.19 

23086 

B 

0 

7 

16 

1.34 

0.30 

1.43 

-0.10 

23086 

C 

0 

2 

4 

0.15 

0.04 

0.33 

-0.23 

23086 

D 

0 

6 

13 

1.60 

0.44 

2.11 

-0.02 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23087 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23087 

A 

1 

34 

74 

1.97 

0.23 

1.59 

0.44 

23087 

B 

0 

8 

17 

0.30 

0.44 

0.67 

-0.41 

23087 

C 

0 

1 

2 

0.12 

0.00 

0.34 

-0.15 

23087 

D 

0 

3 

7 

1.31 

0.77 

2.05 

-0.05 

23088 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23088 

A 

1 

31 

67 

1.86 

0.27 

0.95 

0.44 

23088 

B 

0 

8 

17 

0.20 

0.35 

0.68 

-0.39 

23088 

C 

0 

4 

9 

0.63 

0.22 

0.75 

-0.17 

23088 

D 

0 

3 

7 

1.12 

0.65 

1.67 

-0.05 

23089 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

23089 

A 

1 

25 

57 

2.22 

0.30 

1.00 

0.47 

23089 

B 

0 

9 

20 

0.82 

0.31 

0.79 

-0.29 

23089 

C 

0 

4 

9 

1.25 

0.49 

1.29 

-0.09 

23089 

D 

0 

6 

14 

0.72 

0.40 

0.75 

-0.26 

23090 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23090 

A 

1 

29 

64 

1.54 

0.27 

1.43 

0.31 

23090 

B 

0 

11 

24 

0.83 

0.25 

1.20 

-0.18 

23090 

C 

0 

2 

4 

0.05 

0.95 

0.61 

-0.19 

23090 

D 

0 

3 

7 

0.57 

0.65 

0.99 

-0.14 

23091 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23091 

A 

1 

28 

62 

2.21 

0.32 

0.98 

0.57 

23091 

B 

0 

8 

18 

0.35 

0.35 

0.72 

-0.29 

23091 

C 

0 

6 

13 

-0.01 

0.61 

0.79 

-0.32 

23091 

D 

0 

3 

7 

-0.10 

0.24 

0.35 

-0.23 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23092 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

23092 

A 

1 

21 

49 

1.89 

0.31 

1.61 

0.32 

23092 

B 

0 

15 

35 

0.87 

0.40 

1.57 

-0.25 

23092 

C 

0 

2 

5 

0.37 

1.17 

0.65 

-0.15 

23092 

D 

0 

5 

12 

1.21 

0.70 

1.97 

-0.04 

23093 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

23093 

A 

1 

26 

59 

1.39 

0.28 

1.30 

0.29 

23093 

B 

0 

8 

18 

1.11 

0.50 

4.45 

0.02 

23093 

C 

0 

8 

18 

0.23 

0.39 

0.99 

-0.27 

23093 

D 

0 

2 

5 

-0.43 

1.40 

0.62 

-0.22 

23094 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23094 

A 

1 

28 

62 

1.95 

0.29 

1.22 

0.45 

23094 

B 

0 

9 

20 

0.26 

0.31 

0.66 

-0.36 

23094 

C 

0 

6 

13 

0.66 

0.76 

2.32 

-0.18 

23094 

D 

0 

2 

4 

0.96 

0.04 

0.90 

-0.06 

23095 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23095 

A 

1 

25 

56 

2.09 

0.35 

1.67 

0.37 

23095 

B 

0 

6 

13 

1.19 

0.46 

1.57 

-0.09 

23095 

C 

0 

6 

13 

0.63 

0.45 

0.82 

-0.22 

23095 

D 

0 

8 

18 

0.83 

0.54 

1.56 

-0.21 

23096 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.01 

23096 

A 

1 

29 

67 

1.93 

0.22 

1.16 

0.34 

23096 

B 

0 

8 

19 

1.19 

0.48 

1.45 

-0.18 

23096 

C 

0 

1 

2 

0.07 

0.00 

0.26 

-0.20 

23096 

D 

0 

5 

12 

1.04 

0.33 

0.84 

-0.18 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23097 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23097 

A 

1 

33 

73 

1.99 

0.30 

1.68 

0.25 

23097 

B 

0 

10 

22 

1.23 

0.30 

1.56 

-0.18 

23097 

C 

0 

1 

2 

0.85 

0.00 

0.70 

-0.09 

23097 

D 

0 

1 

2 

0.21 

0.00 

0.37 

-0.15 

23098 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23098 

A 

1 

28 

62 

2.09 

0.28 

1.03 

0.51 

23098 

B 

0 

10 

22 

0.78 

0.33 

1.02 

-0.26 

23098 

C 

0 

3 

7 

0.13 

0.88 

0.78 

-0.24 

23098 

D 

0 

4 

9 

0.12 

0.12 

0.36 

-0.29 

23099 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23099 

A 

1 

20 

44 

2.17 

0.40 

1.41 

0.44 

23099 

B 

0 

14 

31 

1.03 

0.39 

2.46 

-0.13 

23099 

C 

0 

4 

9 

-0.15 

0.37 

0.33 

-0.28 

23099 

D 

0 

7 

16 

0.49 

0.41 

0.75 

-0.22 

23100 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23100 

A 

1 

27 

61 

1.58 

0.20 

1.34 

0.25 

23100 

B 

0 

8 

18 

1.53 

0.41 

2.32 

0.08 

23100 

C 

0 

4 

9 

0.20 

0.75 

0.67 

-0.29 

23100 

D 

0 

5 

11 

0.59 

0.77 

1.15 

-0.22 

23101 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

23101 

A 

1 

33 

77 

1.71 

0.25 

1.31 

0.45 

23101 

B 

0 

2 

5 

-0.02 

1.27 

0.79 

-0.21 

23101 

C 

0 

8 

19 

0.26 

0.22 

0.63 

-0.37 

23101 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23102 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23102 

A 

1 

28 

61 

2.15 

0.27 

1.01 

0.45 

23102 

B 

0 

1 

2 

0.35 

0.00 

0.38 

-0.13 

23102 

C 

0 

17 

37 

0.80 

0.32 

1.27 

-0.41 

23102 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23103 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23103 

A 

1 

36 

80 

1.67 

0.21 

0.94 

0.51 

23103 

B 

0 

1 

2 

-0.56 

0.00 

0.23 

-0.21 

23103 

C 

0 

5 

11 

-0.27 

0.42 

0.43 

-0.43 

23103 

D 

0 

3 

7 

0.59 

0.18 

0.76 

-0.15 

23104 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

23104 

A 

1 

40 

89 

2.04 

0.29 

1.72 

0.16 

23104 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23104 

C 

0 

5 

11 

1.14 

0.56 

2.31 

-0.16 

23104 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23105 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23105 

A 

1 

36 

78 

2.12 

0.27 

0.94 

0.45 

23105 

B 

0 

1 

2 

-1.04 

0.00 

0.14 

-0.24 

23105 

C 

0 

9 

20 

0.41 

0.38 

1.01 

-0.38 

23105 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23106 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23106 

A 

1 

40 

87 

1.62 

0.21 

0.99 

0.44 

23106 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23106 

C 

0 

3 

7 

1.00 

0.21 

1.41 

-0.06 

23106 

D 

0 

3 

7 

-2.06 

1.70 

0.24 

-0.55 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23107 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.01 

23107 

A 

1 

39 

91 

1.73 

0.24 

1.00 

0.25 

23107 

B 

0 

2 

5 

-1.02 

1.07 

0.29 

-0.37 

23107 

C 

0 

1 

2 

2.71 

0.00 

7.31 

0.11 

23107 

D 

0 

1 

2 

0.80 

0.00 

1.08 

-0.08 

23108 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23108 

A 

1 

42 

93 

1.77 

0.24 

0.94 

0.31 

23108 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23108 

C 

0 

2 

4 

-0.31 

0.96 

0.51 

-0.27 

23108 

D 

0 

1 

2 

0.17 

0.00 

0.56 

-0.14 

23109 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23109 

A 

1 

34 

76 

1.66 

0.24 

1.22 

0.35 

23109 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23109 

C 

0 

10 

22 

0.44 

0.43 

1.08 

-0.34 

23109 

D 

0 

1 

2 

1.03 

0.00 

1.09 

-0.04 

23110 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

23110 

A 

1 

38 

83 

1.75 

0.17 

0.82 

0.49 

23110 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23110 

C 

0 

5 

11 

0.64 

0.50 

0.98 

-0.24 

23110 

D 

0 

3 

7 

-0.59 

0.71 

0.33 

-0.45 

23111 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23111 

A 

1 

39 

87 

1.67 

0.25 

1.07 

0.36 

23111 

B 

0 

1 

2 

0.33 

0.00 

0.72 

-0.11 

23111 

C 

0 

3 

7 

-0.27 

0.86 

0.76 

-0.29 

23111 

D 

0 

2 

4 

0.18 

0.29 

0.65 

-0.17 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23112 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23112 

A 

1 

36 

80 

1.74 

0.23 

0.79 

0.47 

23112 

B 

0 

1 

2 

-1.56 

0.00 

0.09 

-0.28 

23112 

C 

0 

4 

9 

0.15 

0.41 

0.63 

-0.24 

23112 

D 

0 

4 

9 

-0.06 

1.26 

1.15 

-0.28 

23113 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23113 

A 

1 

31 

69 

2.28 

0.27 

0.95 

0.50 

23113 

B 

0 

4 

9 

0.70 

0.54 

0.98 

-0.21 

23113 

C 

0 

10 

22 

0.56 

0.34 

0.83 

-0.41 

23113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23114 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

23114 

A 

1 

28 

64 

2.16 

0.33 

2.36 

0.41 

23114 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23114 

C 

0 

12 

27 

1.11 

0.25 

1.14 

-0.18 

23114 

D 

0 

4 

9 

-0.62 

1.06 

0.48 

-0.41 

23115 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23115 

A 

1 

30 

68 

1.80 

0.21 

0.84 

0.54 

23115 

B 

0 

4 

9 

0.19 

0.41 

0.56 

-0.26 

23115 

C 

0 

4 

9 

0.34 

0.53 

0.68 

-0.22 

23115 

D 

0 

6 

14 

0.11 

0.65 

0.77 

-0.34 

23116 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23116 

A 

1 

26 

58 

2.07 

0.35 

1.94 

0.40 

23116 

B 

0 

2 

4 

-0.66 

1.07 

0.25 

-0.28 

23116 

C 

0 

11 

24 

0.95 

0.35 

1.29 

-0.19 

23116 

D 

0 

6 

13 

0.73 

0.41 

1.04 

-0.18 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23117 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23117 

A 

1 

36 

80 

1.51 

0.29 

1.29 

0.16 

23117 

B 

0 

3 

7 

0.29 

0.40 

0.79 

-0.18 

23117 

C 

0 

6 

13 

1.15 

0.61 

3.19 

-0.06 

23117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23118 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23118 

A 

1 

23 

51 

2.26 

0.37 

1.22 

0.46 

23118 

B 

0 

4 

9 

0.22 

0.45 

0.56 

-0.25 

23118 

C 

0 

16 

36 

1.01 

0.27 

1.43 

-0.24 

23118 

D 

0 

2 

4 

0.03 

0.67 

0.40 

-0.20 

23119 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23119 

A 

1 

30 

68 

2.13 

0.25 

0.74 

0.60 

23119 

B 

0 

4 

9 

0.77 

0.28 

0.83 

-0.13 

23119 

C 

0 

6 

14 

0.48 

0.41 

0.81 

-0.23 

23119 

D 

0 

4 

9 

-1.58 

0.84 

0.13 

-0.57 

23120 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.04 

23120 

A 

1 

33 

72 

1.46 

0.27 

0.91 

0.46 

23120 

B 

0 

2 

4 

-0.78 

0.73 

0.36 

-0.22 

23120 

C 

0 

9 

20 

0.17 

0.40 

1.26 

-0.23 

23120 

D 

0 

2 

4 

-1.76 

1.77 

0.32 

-0.34 

23121 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23121 

A 

1 

41 

91 

1.56 

0.23 

1.19 

0.14 

23121 

B 

0 

1 

2 

1.55 

0.00 

2.17 

0.00 

23121 

C 

0 

2 

4 

0.20 

0.58 

0.66 

-0.20 

23121 

D 

0 

1 

2 

1.54 

0.00 

2.15 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23122 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23122 

A 

1 

38 

83 

1.68 

0.24 

1.07 

0.45 

23122 

B 

0 

3 

7 

0.53 

0.53 

1.05 

-0.15 

23122 

C 

0 

2 

4 

-0.54 

0.31 

0.30 

-0.27 

23122 

D 

0 

3 

7 

-0.45 

0.72 

0.51 

-0.32 

23123 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23123 

A 

1 

40 

87 

1.59 

0.20 

1.01 

0.30 

23123 

B 

0 

1 

2 

1.13 

0.00 

1.24 

-0.04 

23123 

C 

0 

5 

11 

0.29 

0.51 

0.87 

-0.31 

23123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23124 

* 

-1 

3943 

99 

1.52 

0.02 

0.00 

0.02 

23124 

A 

1 

23 

47 

1.20 

0.26 

2.46 

-0.02 

23124 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23124 

C 

0 

24 

49 

1.56 

0.27 

2.00 

0.22 

23124 

D 

0 

2 

4 

-2.52 

2.00 

0.14 

-0.51 

23125 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23125 

A 

1 

17 

38 

1.48 

0.45 

3.64 

0.10 

23125 

B 

0 

13 

29 

1.21 

0.21 

1.02 

-0.04 

23125 

C 

0 

15 

33 

1.18 

0.35 

1.63 

-0.06 

23125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23126 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

23126 

A 

1 

4 

9 

0.53 

0.53 

4.92 

-0.24 

23126 

B 

0 

15 

35 

1.28 

0.30 

1.02 

-0.03 

23126 

C 

0 

22 

51 

1.55 

0.22 

1.39 

0.22 

23126 

D 

0 

2 

5 

0.71 

0.03 

0.36 

-0.13 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23127 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23127 

A 

1 

41 

89 

1.49 

0.22 

1.08 

0.24 

23127 

B 

0 

2 

4 

1.04 

0.42 

1.41 

-0.05 

23127 

C 

0 

1 

2 

0.68 

0.00 

0.90 

-0.08 

23127 

D 

0 

2 

4 

-0.23 

0.24 

0.37 

-0.25 

23128 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23128 

A 

1 

35 

78 

1.66 

0.24 

1.25 

0.07 

23128 

B 

0 

1 

2 

2.05 

0.00 

2.37 

0.05 

23128 

C 

0 

8 

18 

1.35 

0.44 

1.86 

-0.09 

23128 

D 

0 

1 

2 

1.48 

0.00 

1.34 

-0.01 

23129 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

23129 

A 

1 

33 

75 

1.97 

0.26 

1.76 

0.38 

23129 

B 

0 

2 

5 

0.62 

0.28 

0.58 

-0.16 

23129 

C 

0 

7 

16 

0.69 

0.34 

0.82 

-0.29 

23129 

D 

0 

2 

5 

0.92 

0.47 

0.85 

-0.11 

23130 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

23130 

A 

1 

22 

49 

1.88 

0.31 

1.31 

0.46 

23130 

B 

0 

10 

22 

0.64 

0.37 

1.13 

-0.15 

23130 

C 

0 

7 

16 

0.06 

0.41 

0.59 

-0.27 

23130 

D 

0 

6 

13 

0.18 

1.05 

3.21 

-0.21 

23131 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

23131 

A 

1 

40 

91 

1.66 

0.25 

0.99 

0.32 

23131 

B 

0 

1 

2 

-0.60 

0.00 

0.29 

-0.20 

23131 

C 

0 

2 

5 

0.35 

0.77 

1.00 

-0.16 

23131 

D 

0 

1 

2 

-0.69 

0.00 

0.27 

-0.21 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23132 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23132 

A 

1 

40 

89 

1.42 

0.25 

0.86 

0.42 

23132 

B 

0 

1 

2 

-2.15 

0.00 

0.09 

-0.30 

23132 

C 

0 

3 

7 

0.10 

0.10 

0.82 

-0.17 

23132 

D 

0 

1 

2 

-2.03 

0.00 

0.10 

-0.29 

23133 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

23133 

A 

1 

31 

70 

1.58 

0.30 

1.43 

0.45 

23133 

B 

0 

2 

5 

-0.63 

1.61 

0.77 

-0.23 

23133 

C 

0 

8 

18 

0.27 

0.24 

0.97 

-0.24 

23133 

D 

0 

3 

7 

-0.49 

0.87 

0.73 

-0.26 

23134 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

23134 

A 

1 

38 

84 

1.51 

0.22 

0.85 

0.52 

23134 

B 

0 

2 

4 

-1.04 

0.35 

0.23 

-0.30 

23134 

C 

0 

2 

4 

-0.41 

0.35 

0.42 

-0.21 

23134 

D 

0 

3 

7 

-0.82 

1.53 

0.85 

-0.33 

23135 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23135 

A 

1 

37 

82 

1.70 

0.26 

0.90 

0.41 

23135 

B 

0 

4 

9 

-0.81 

0.39 

0.30 

-0.42 

23135 

C 

0 

3 

7 

1.19 

0.43 

2.12 

-0.03 

23135 

D 

0 

1 

2 

-0.90 

0.00 

0.22 

-0.21 

23136 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

23136 

A 

1 

41 

93 

1.63 

0.24 

1.12 

0.38 

23136 

B 

0 

1 

2 

-1.29 

0.00 

0.18 

-0.27 

23136 

C 

0 

1 

2 

0.07 

0.00 

0.68 

-0.14 

23136 

D 

0 

1 

2 

-0.90 

0.00 

0.26 

-0.23 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23137 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23137 

A 

1 

15 

33 

2.14 

0.37 

1.28 

0.36 

23137 

B 

0 

2 

4 

1.55 

0.62 

1.13 

0.02 

23137 

C 

0 

26 

57 

1.03 

0.27 

1.19 

-0.27 

23137 

D 

0 

3 

7 

0.51 

1.29 

1.01 

-0.16 

23138 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

0.00 

23138 

A 

1 

11 

25 

2.88 

0.47 

0.70 

0.53 

23138 

B 

0 

2 

5 

0.05 

2.08 

0.80 

-0.23 

23138 

C 

0 

30 

68 

1.19 

0.19 

0.95 

-0.38 

23138 

D 

0 

1 

2 

1.25 

0.00 

0.65 

-0.03 

23139 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23139 

A 

1 

30 

67 

1.71 

0.22 

1.18 

0.48 

23139 

B 

0 

2 

4 

0.19 

0.30 

0.43 

-0.18 

23139 

C 

0 

6 

13 

1.17 

0.32 

1.45 

-0.03 

23139 

D 

0 

7 

16 

-0.15 

0.35 

0.42 

-0.48 

23140 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23140 

A 

1 

34 

76 

1.50 

0.27 

1.51 

0.34 

23140 

B 

0 

3 

7 

-0.10 

0.51 

0.59 

-0.23 

23140 

C 

0 

7 

16 

0.41 

0.25 

0.92 

-0.23 

23140 

D 

0 

1 

2 

0.80 

0.00 

1.10 

-0.04 

23141 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.01 

23141 

A 

1 

39 

91 

1.82 

0.25 

0.97 

0.33 

23141 

B 

0 

1 

2 

1.01 

0.00 

1.21 

-0.06 

23141 

C 

0 

2 

5 

-0.08 

0.01 

0.40 

-0.25 

23141 

D 

0 

1 

2 

-0.62 

0.00 

0.24 

-0.23 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23142 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23142 

A 

1 

38 

84 

1.95 

0.24 

1.12 

0.41 

23142 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23142 

C 

0 

6 

13 

0.36 

0.17 

0.57 

-0.35 

23142 

D 

0 

1 

2 

-0.36 

0.00 

0.26 

-0.21 

23143 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.02 

23143 

A 

1 

35 

80 

2.14 

0.27 

0.89 

0.46 

23143 

B 

0 

1 

2 

0.72 

0.00 

0.84 

-0.09 

23143 

C 

0 

6 

14 

0.53 

0.52 

1.21 

-0.28 

23143 

D 

0 

2 

5 

-0.99 

0.66 

0.19 

-0.35 

23144 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23144 

A 

1 

29 

63 

2.22 

0.33 

1.34 

0.44 

23144 

B 

0 

2 

4 

-0.45 

0.82 

0.27 

-0.25 

23144 

C 

0 

10 

22 

0.82 

0.48 

1.46 

-0.24 

23144 

D 

0 

5 

11 

0.66 

0.23 

0.67 

-0.19 

23145 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23145 

A 

1 

36 

78 

1.77 

0.28 

1.41 

0.22 

23145 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23145 

C 

0 

9 

20 

1.11 

0.43 

2.49 

-0.14 

23145 

D 

0 

1 

2 

-0.87 

0.00 

0.18 

-0.22 

23146 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23146 

A 

1 

13 

29 

1.16 

0.34 

2.43 

-0.03 

23146 

B 

0 

3 

7 

-0.06 

1.24 

0.88 

-0.29 

23146 

C 

0 

28 

62 

1.42 

0.20 

1.47 

0.22 

23146 

D 

0 

1 

2 

0.03 

0.00 

0.23 

-0.15 

easyCBM  CCSS  Second  Grade  Math  Measure  Development 


411 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23147 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23147 

A 

1 

38 

84 

1.62 

0.21 

1.02 

0.32 

23147 

B 

0 

7 

16 

0.50 

0.40 

0.91 

-0.32 

23147 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23147 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23148 

* 

-1 

3789 

95 

1.50 

0.02 

0.00 

-0.04 

23148 

A 

1 

175 

86 

1.93 

0.10 

1.21 

0.33 

23148 

B 

0 

15 

7 

0.91 

0.32 

1.58 

-0.17 

23148 

C 

0 

10 

5 

0.39 

0.32 

0.86 

-0.22 

23148 

D 

0 

3 

1 

-0.42 

0.83 

0.34 

-0.19 

23149 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.04 

23149 

A 

1 

41 

93 

2.28 

0.22 

0.84 

0.50 

23149 

B 

0 

1 

2 

-0.26 

0.00 

0.27 

-0.23 

23149 

C 

0 

2 

5 

-1.05 

0.12 

0.12 

-0.44 

23149 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23150 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23150 

A 

1 

27 

60 

2.04 

0.28 

1.34 

0.35 

23150 

B 

0 

1 

2 

0.78 

0.00 

0.55 

-0.09 

23150 

C 

0 

17 

38 

0.99 

0.34 

1.46 

-0.33 

23150 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23151 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23151 

A 

1 

44 

98 

1.38 

0.24 

1.03 

0.12 

23151 

B 

0 

1 

2 

0.12 

0.00 

0.77 

-0.12 

23151 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23151 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23152 

* 

-1 

3945 

99 

1.52 

0.02 

0.00 

0.03 

23152 

A 

1 

46 

98 

1.25 

0.20 

0.90 

0.35 

23152 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23152 

C 

0 

1 

2 

-2.15 

0.00 

0.10 

-0.35 

23152 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23153 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23153 

A 

1 

43 

96 

1.94 

0.25 

0.67 

0.47 

23153 

B 

0 

1 

2 

-3.11 

0.00 

0.03 

-0.41 

23153 

C 

0 

1 

2 

-1.17 

0.00 

0.21 

-0.25 

23153 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23154 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

23154 

A 

1 

43 

96 

1.27 

0.21 

0.65 

0.48 

23154 

B 

0 

1 

2 

-0.68 

0.00 

0.45 

-0.18 

23154 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23154 

D 

0 

1 

2 

-3.85 

0.00 

0.02 

-0.49 

23155 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23155 

A 

1 

43 

96 

1.52 

0.22 

0.91 

0.39 

23155 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23155 

C 

0 

2 

4 

-1.39 

0.65 

0.21 

-0.39 

23155 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23156 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23156 

A 

1 

43 

96 

1.26 

0.18 

1.02 

0.20 

23156 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23156 

C 

0 

2 

4 

0.11 

0.75 

0.77 

-0.20 

23156 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23157 

* 

-1 

3808 

95 

1.50 

0.02 

0.00 

-0.06 

23157 

A 

1 

173 

94 

2.04 

0.09 

0.86 

0.33 

23157 

B 

0 

1 

1 

3.28 

0.00 

7.87 

0.07 

23157 

C 

0 

9 

5 

0.29 

0.35 

0.62 

-0.27 

23157 

D 

0 

1 

1 

-4.02 

0.00 

0.01 

-0.32 

23158 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23158 

A 

1 

37 

82 

2.06 

0.25 

0.77 

0.52 

23158 

B 

0 

6 

13 

0.13 

0.38 

0.70 

-0.36 

23158 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23158 

D 

0 

2 

4 

-1.05 

0.38 

0.16 

-0.35 

23159 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23159 

A 

1 

41 

91 

1.54 

0.20 

0.86 

0.42 

23159 

B 

0 

4 

9 

-0.48 

0.38 

0.38 

-0.42 

23159 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23159 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23160 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23160 

A 

1 

42 

93 

1.25 

0.22 

1.22 

0.16 

23160 

B 

0 

1 

2 

0.86 

0.00 

1.48 

-0.04 

23160 

C 

0 

2 

4 

0.11 

0.46 

0.78 

-0.17 

23160 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23161 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23161 

A 

1 

41 

89 

1.81 

0.24 

0.86 

0.59 

23161 

B 

0 

1 

2 

0.08 

0.00 

0.64 

-0.11 

23161 

C 

0 

2 

4 

-1.09 

0.41 

0.21 

-0.29 

23161 

D 

0 

2 

4 

-3.26 

1.27 

0.08 

-0.53 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23162 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23162 

A 

-1 

45 

100 

1.56 

0.23 

0.00 

0.00 

23162 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

23162 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

23162 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

23163 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23163 

A 

1 

36 

80 

1.67 

0.24 

1.03 

0.45 

23163 

B 

0 

2 

4 

-1.49 

0.66 

0.13 

-0.41 

23163 

C 

0 

7 

16 

0.39 

0.24 

0.81 

-0.27 

23163 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23164 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

23164 

A 

1 

20 

44 

2.57 

0.35 

1.24 

0.44 

23164 

B 

0 

22 

49 

1.38 

0.21 

1.07 

-0.35 

23164 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23164 

D 

0 

3 

7 

1.01 

0.83 

1.03 

-0.17 

23165 

* 

-1 

3778 

95 

1.51 

0.02 

0.00 

-0.02 

23165 

A 

1 

199 

93 

1.74 

0.08 

1.02 

0.24 

23165 

B 

0 

5 

2 

-0.30 

0.12 

0.25 

-0.26 

23165 

C 

0 

10 

5 

1.09 

0.34 

1.68 

-0.11 

23165 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23166 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23166 

A 

1 

32 

71 

2.20 

0.22 

0.80 

0.54 

23166 

B 

0 

5 

11 

0.91 

0.57 

1.29 

-0.20 

23166 

C 

0 

6 

13 

0.18 

0.49 

0.63 

-0.43 

23166 

D 

0 

2 

4 

0.54 

0.20 

0.48 

-0.18 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23167 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23167 

A 

1 

37 

84 

1.38 

0.28 

1.20 

0.20 

23167 

B 

0 

6 

14 

0.57 

0.47 

1.82 

-0.16 

23167 

C 

0 

1 

2 

-0.06 

0.00 

0.58 

-0.12 

23167 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23168 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

23168 

A 

1 

34 

74 

1.46 

0.24 

1.25 

0.24 

23168 

B 

0 

3 

7 

1.09 

0.93 

2.44 

-0.03 

23168 

C 

0 

8 

17 

0.72 

0.59 

2.81 

-0.16 

23168 

D 

0 

1 

2 

-1.25 

0.00 

0.13 

-0.25 

23169 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23169 

A 

1 

37 

84 

1.62 

0.28 

1.00 

0.38 

23169 

B 

0 

5 

11 

0.58 

0.36 

1.39 

-0.15 

23169 

C 

0 

1 

2 

-1.09 

0.00 

0.20 

-0.20 

23169 

D 

0 

1 

2 

-3.76 

0.00 

0.01 

-0.43 

23170 

* 

-1 

3757 

94 

1.52 

0.02 

0.00 

0.02 

23170 

A 

1 

148 

63 

1.71 

0.10 

1.52 

0.37 

23170 

B 

0 

4 

2 

0.65 

0.17 

0.58 

-0.08 

23170 

C 

0 

82 

35 

0.87 

0.09 

1.03 

-0.31 

23170 

D 

0 

1 

0 

-4.52 

0.00 

0.00 

-0.33 

23171 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23171 

A 

1 

44 

98 

1.79 

0.21 

0.99 

0.20 

23171 

B 

0 

1 

2 

-0.11 

0.00 

0.34 

-0.20 

23171 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23171 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23172 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23172 

A 

1 

43 

93 

1.56 

0.21 

1.19 

0.33 

23172 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23172 

C 

0 

3 

7 

-0.34 

0.76 

0.71 

-0.33 

23172 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23173 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

23173 

A 

1 

35 

78 

1.34 

0.22 

1.15 

0.35 

23173 

B 

0 

2 

4 

-0.90 

0.83 

0.29 

-0.32 

23173 

C 

0 

6 

13 

0.70 

0.53 

1.71 

-0.11 

23173 

D 

0 

2 

4 

-0.15 

0.36 

0.47 

-0.20 

23174 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23174 

A 

1 

39 

87 

1.62 

0.26 

0.76 

0.56 

23174 

B 

0 

3 

7 

-1.38 

0.20 

0.23 

-0.38 

23174 

C 

0 

1 

2 

-1.01 

0.00 

0.32 

-0.18 

23174 

D 

0 

2 

4 

-1.71 

0.36 

0.17 

-0.34 

23175 

* 

-1 

3773 

95 

1.52 

0.02 

0.00 

0.00 

23175 

A 

1 

109 

50 

1.97 

0.11 

1.06 

0.38 

23175 

B 

0 

28 

13 

0.59 

0.19 

0.67 

-0.29 

23175 

C 

0 

81 

37 

1.22 

0.11 

1.25 

-0.19 

23175 

D 

0 

1 

0 

1.13 

0.00 

0.72 

-0.02 

23176 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23176 

A 

1 

12 

27 

2.16 

0.55 

2.87 

0.20 

23176 

B 

0 

31 

69 

1.52 

0.24 

1.52 

-0.13 

23176 

C 

0 

1 

2 

2.73 

0.00 

2.25 

0.11 

23176 

D 

0 

1 

2 

-1.46 

0.00 

0.03 

-0.30 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23177 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23177 

A 

1 

42 

93 

1.58 

0.21 

0.93 

0.32 

23177 

B 

0 

3 

7 

-0.25 

1.01 

0.82 

-0.32 

23177 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23177 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23178 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

23178 

A 

1 

36 

78 

1.41 

0.23 

1.16 

0.24 

23178 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23178 

C 

0 

10 

22 

0.62 

0.39 

1.61 

-0.24 

23178 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23179 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

23179 

A 

1 

42 

93 

1.17 

0.20 

0.90 

0.39 

23179 

B 

0 

1 

2 

-0.56 

0.00 

0.42 

-0.18 

23179 

C 

0 

1 

2 

0.08 

0.00 

0.80 

-0.11 

23179 

D 

0 

1 

2 

-2.24 

0.00 

0.08 

-0.37 

23180 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

23180 

A 

1 

38 

83 

1.78 

0.21 

1.03 

0.38 

23180 

B 

0 

4 

9 

0.55 

0.45 

0.87 

-0.22 

23180 

C 

0 

3 

7 

0.84 

1.04 

1.62 

-0.13 

23180 

D 

0 

1 

2 

-1.46 

0.00 

0.08 

-0.33 

23181 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.01 

23181 

A 

1 

35 

81 

2.12 

0.29 

0.90 

0.47 

23181 

B 

0 

1 

2 

0.62 

0.00 

0.80 

-0.09 

23181 

C 

0 

6 

14 

-0.14 

0.38 

0.50 

-0.42 

23181 

D 

0 

1 

2 

-0.09 

0.00 

0.39 

-0.16 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23182 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23182 

A 

1 

36 

80 

1.94 

0.25 

1.34 

0.35 

23182 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23182 

C 

0 

9 

20 

0.66 

0.27 

0.87 

-0.35 

23182 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23183 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23183 

A 

1 

37 

84 

1.56 

0.20 

1.12 

0.24 

23183 

B 

0 

6 

14 

0.71 

0.23 

0.82 

-0.25 

23183 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23183 

D 

0 

1 

2 

1.33 

0.00 

1.34 

-0.01 

23184 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

23184 

A 

1 

43 

93 

1.59 

0.25 

0.97 

0.17 

23184 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23184 

C 

0 

3 

7 

0.45 

1.15 

2.38 

-0.17 

23184 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23185 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23185 

A 

1 

30 

67 

1.40 

0.27 

1.90 

0.11 

23185 

B 

0 

13 

29 

1.26 

0.17 

1.45 

-0.02 

23185 

C 

0 

1 

2 

2.03 

0.00 

2.59 

0.08 

23185 

D 

0 

1 

2 

-2.00 

0.00 

0.05 

-0.37 

23186 

* 

-1 

3945 

99 

1.52 

0.02 

0.00 

0.02 

23186 

A 

1 

35 

74 

1.52 

0.19 

0.93 

0.40 

23186 

B 

0 

1 

2 

-0.39 

0.00 

0.28 

-0.19 

23186 

C 

0 

11 

23 

0.44 

0.38 

1.45 

-0.35 

23186 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23187 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

23187 

A 

1 

36 

80 

1.69 

0.24 

1.12 

0.16 

23187 

B 

0 

7 

16 

1.16 

0.52 

3.76 

-0.12 

23187 

C 

0 

2 

4 

0.93 

1.54 

2.19 

-0.10 

23187 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23188 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23188 

A 

1 

36 

78 

1.74 

0.20 

0.79 

0.45 

23188 

B 

0 

3 

7 

-0.27 

0.28 

0.31 

-0.28 

23188 

C 

0 

5 

11 

1.15 

0.84 

2.41 

-0.05 

23188 

D 

0 

2 

4 

-2.29 

2.01 

0.14 

-0.50 

23189 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

23189 

A 

1 

33 

72 

1.64 

0.20 

1.06 

0.48 

23189 

B 

0 

10 

22 

0.40 

0.29 

0.80 

-0.38 

23189 

C 

0 

3 

7 

0.12 

0.61 

0.62 

-0.25 

23189 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23190 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23190 

A 

1 

38 

84 

1.63 

0.23 

0.94 

0.32 

23190 

B 

0 

2 

4 

1.65 

0.88 

3.44 

0.03 

23190 

C 

0 

3 

7 

-0.48 

0.63 

0.41 

-0.33 

23190 

D 

0 

2 

4 

-0.02 

1.77 

1.38 

-0.20 

23191 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23191 

A 

1 

28 

62 

1.96 

0.32 

1.19 

0.46 

23191 

B 

0 

16 

36 

0.44 

0.27 

1.00 

-0.42 

23191 

C 

0 

1 

2 

-0.11 

0.00 

0.35 

-0.14 

23191 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23192 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23192 

A 

1 

43 

96 

1.51 

0.22 

1.14 

0.03 

23192 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23192 

C 

0 

2 

4 

1.33 

0.17 

1.96 

-0.03 

23192 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23193 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

23193 

A 

1 

25 

56 

1.44 

0.27 

1.65 

0.26 

23193 

B 

0 

3 

7 

0.90 

0.89 

1.85 

-0.05 

23193 

C 

0 

15 

33 

0.77 

0.30 

1.33 

-0.20 

23193 

D 

0 

2 

4 

0.49 

0.26 

0.58 

-0.11 

23194 

* 

-1 

3940 

99 

1.52 

0.02 

0.00 

0.00 

23194 

A 

1 

29 

56 

2.03 

0.26 

1.56 

0.40 

23194 

B 

0 

19 

37 

1.14 

0.25 

1.18 

-0.19 

23194 

C 

0 

3 

6 

-0.34 

0.95 

0.34 

-0.31 

23194 

D 

0 

1 

2 

-1.46 

0.00 

0.05 

-0.28 

23195 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.00 

23195 

A 

1 

20 

47 

2.01 

0.26 

1.11 

0.39 

23195 

B 

0 

19 

44 

1.32 

0.22 

1.18 

-0.15 

23195 

C 

0 

3 

7 

0.09 

0.47 

0.30 

-0.33 

23195 

D 

0 

1 

2 

-0.38 

0.00 

0.15 

-0.25 

23196 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23196 

A 

1 

23 

50 

1.87 

0.31 

1.53 

0.36 

23196 

B 

0 

3 

7 

1.14 

0.87 

1.46 

-0.04 

23196 

C 

0 

19 

41 

0.95 

0.24 

1.11 

-0.25 

23196 

D 

0 

1 

2 

-1.36 

0.00 

0.07 

-0.29 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23197 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23197 

A 

1 

39 

87 

1.66 

0.25 

1.59 

0.13 

23197 

B 

0 

2 

4 

0.86 

0.57 

1.14 

-0.11 

23197 

C 

0 

3 

7 

1.16 

0.44 

1.54 

-0.08 

23197 

D 

0 

1 

2 

1.39 

0.00 

1.64 

-0.02 

23198 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23198 

A 

1 

22 

49 

1.90 

0.27 

0.96 

0.40 

23198 

B 

0 

3 

7 

-0.87 

1.06 

0.33 

-0.36 

23198 

C 

0 

19 

42 

0.94 

0.36 

2.69 

-0.17 

23198 

D 

0 

1 

2 

-0.74 

0.00 

0.14 

-0.19 

23199 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23199 

A 

1 

13 

29 

1.87 

0.46 

2.10 

0.34 

23199 

B 

0 

23 

51 

0.97 

0.19 

0.96 

-0.17 

23199 

C 

0 

7 

16 

0.98 

0.53 

1.26 

-0.07 

23199 

D 

0 

2 

4 

0.00 

0.37 

0.27 

-0.20 

23200 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23200 

A 

1 

27 

60 

1.87 

0.25 

1.01 

0.37 

23200 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23200 

C 

0 

17 

38 

0.91 

0.33 

1.97 

-0.30 

23200 

D 

0 

1 

2 

-0.81 

0.00 

0.14 

-0.24 

23201 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23201 

A 

1 

33 

75 

1.88 

0.28 

0.84 

0.50 

23201 

B 

0 

3 

7 

-0.24 

0.41 

0.44 

-0.27 

23201 

C 

0 

6 

14 

0.52 

0.16 

0.86 

-0.21 

23201 

D 

0 

2 

5 

-1.40 

0.47 

0.13 

-0.37 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23202 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23202 

A 

1 

14 

31 

1.57 

0.38 

1.96 

0.13 

23202 

B 

0 

3 

7 

1.48 

0.46 

1.22 

0.03 

23202 

C 

0 

27 

60 

1.25 

0.25 

1.50 

-0.06 

23202 

D 

0 

1 

2 

-0.93 

0.00 

0.09 

-0.26 

23203 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.02 

23203 

A 

1 

29 

63 

2.25 

0.19 

0.92 

0.51 

23203 

B 

0 

1 

2 

-2.15 

0.00 

0.02 

-0.44 

23203 

C 

0 

15 

33 

1.17 

0.28 

1.02 

-0.30 

23203 

D 

0 

1 

2 

-0.87 

0.00 

0.08 

-0.29 

23204 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23204 

A 

1 

35 

80 

1.66 

0.27 

1.06 

0.43 

23204 

B 

0 

3 

7 

0.62 

0.60 

1.34 

-0.10 

23204 

C 

0 

3 

7 

0.19 

0.27 

0.70 

-0.17 

23204 

D 

0 

3 

7 

-1.36 

1.69 

0.90 

-0.41 

23205 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23205 

A 

1 

28 

62 

1.61 

0.30 

1.93 

0.15 

23205 

B 

0 

13 

29 

1.35 

0.30 

2.07 

-0.05 

23205 

C 

0 

4 

9 

0.71 

0.08 

0.63 

-0.17 

23205 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23206 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23206 

A 

1 

13 

29 

2.25 

0.47 

2.28 

0.28 

23206 

B 

0 

31 

69 

1.48 

0.19 

1.19 

-0.22 

23206 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23206 

D 

0 

1 

2 

0.16 

0.00 

0.19 

-0.17 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23207 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23207 

A 

1 

41 

91 

1.46 

0.23 

1.08 

0.16 

23207 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23207 

C 

0 

4 

9 

0.65 

0.50 

1.28 

-0.16 

23207 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23208 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

23208 

A 

1 

33 

75 

1.91 

0.25 

1.04 

0.43 

23208 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23208 

C 

0 

9 

20 

0.57 

0.22 

0.70 

-0.35 

23208 

D 

0 

2 

5 

0.19 

0.39 

0.43 

-0.21 

23209 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23209 

A 

1 

1 

2 

-1.27 

0.00 

76.31 

-0.24 

23209 

B 

0 

2 

4 

-0.73 

0.14 

0.02 

-0.28 

23209 

C 

0 

41 

89 

1.73 

0.25 

0.99 

0.20 

23209 

D 

0 

2 

4 

2.87 

2.49 

5.01 

0.15 

23210 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

23210 

A 

1 

35 

78 

2.22 

0.24 

1.01 

0.34 

23210 

B 

0 

1 

2 

-0.18 

0.00 

0.22 

-0.22 

23210 

C 

0 

7 

16 

1.15 

0.63 

2.23 

-0.23 

23210 

D 

0 

2 

4 

1.04 

0.80 

0.98 

-0.13 

23211 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23211 

A 

1 

29 

64 

2.22 

0.35 

1.22 

0.39 

23211 

B 

0 

6 

13 

1.48 

0.48 

2.12 

-0.04 

23211 

C 

0 

7 

16 

0.82 

0.45 

1.19 

-0.19 

23211 

D 

0 

3 

7 

-1.35 

1.23 

0.19 

-0.42 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23212 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.04 

23212 

A 

1 

27 

60 

2.25 

0.34 

2.44 

0.18 

23212 

B 

0 

10 

22 

1.95 

0.26 

1.65 

-0.03 

23212 

C 

0 

6 

13 

1.20 

0.58 

1.06 

-0.21 

23212 

D 

0 

2 

4 

1.96 

0.70 

1.55 

-0.01 

23213 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23213 

A 

1 

29 

64 

2.16 

0.24 

1.02 

0.51 

23213 

B 

0 

8 

18 

0.78 

0.49 

1.00 

-0.27 

23213 

C 

0 

3 

7 

0.73 

0.25 

0.56 

-0.17 

23213 

D 

0 

5 

11 

0.33 

0.44 

0.46 

-0.32 

23214 

* 

-1 

3954 

99 

1.52 

0.02 

0.00 

0.01 

23214 

A 

1 

23 

61 

1.69 

0.31 

1.42 

0.33 

23214 

B 

0 

7 

18 

0.61 

0.35 

0.80 

-0.26 

23214 

C 

0 

5 

13 

1.15 

0.41 

1.48 

-0.05 

23214 

D 

0 

3 

8 

0.61 

0.78 

0.95 

-0.16 

23215 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23215 

A 

1 

19 

42 

1.87 

0.35 

1.58 

0.31 

23215 

B 

0 

14 

31 

1.32 

0.30 

1.45 

-0.04 

23215 

C 

0 

4 

9 

0.98 

0.35 

0.76 

-0.10 

23215 

D 

0 

8 

18 

0.60 

0.46 

0.79 

-0.28 

23216 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23216 

A 

1 

22 

49 

1.77 

0.31 

1.61 

0.37 

23216 

B 

0 

11 

24 

1.33 

0.32 

1.86 

0.04 

23216 

C 

0 

7 

16 

0.01 

0.38 

0.46 

-0.37 

23216 

D 

0 

5 

11 

0.29 

0.63 

0.74 

-0.23 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23217 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

23217 

A 

1 

29 

66 

1.23 

0.29 

1.52 

0.11 

23217 

B 

0 

9 

20 

1.64 

0.47 

4.74 

0.18 

23217 

C 

0 

3 

7 

-0.19 

0.71 

0.67 

-0.23 

23217 

D 

0 

3 

7 

-0.34 

0.42 

0.42 

-0.26 

23218 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

23218 

A 

1 

19 

44 

1.76 

0.38 

2.72 

0.19 

23218 

B 

0 

12 

28 

1.16 

0.37 

1.32 

-0.10 

23218 

C 

0 

8 

19 

2.12 

0.49 

3.16 

0.21 

23218 

D 

0 

4 

9 

-0.93 

0.55 

0.14 

-0.46 

23219 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23219 

A 

1 

27 

59 

1.93 

0.30 

1.68 

0.27 

23219 

B 

0 

10 

22 

1.40 

0.44 

1.98 

-0.08 

23219 

C 

0 

2 

4 

1.60 

0.37 

1.36 

0.00 

23219 

D 

0 

7 

15 

0.67 

0.19 

0.55 

-0.28 

23220 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23220 

A 

1 

22 

49 

2.09 

0.37 

1.51 

0.33 

23220 

B 

0 

12 

27 

1.74 

0.32 

2.54 

0.08 

23220 

C 

0 

5 

11 

0.20 

0.66 

0.93 

-0.29 

23220 

D 

0 

6 

13 

0.21 

0.49 

0.53 

-0.32 

23221 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

23221 

A 

1 

27 

60 

1.60 

0.26 

1.34 

0.52 

23221 

B 

0 

9 

20 

0.07 

0.32 

0.65 

-0.36 

23221 

C 

0 

5 

11 

0.18 

0.41 

0.67 

-0.22 

23221 

D 

0 

4 

9 

0.43 

0.37 

0.76 

-0.14 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23222 

* 

-1 

3950 

99 

1.52 

0.02 

0.00 

0.03 

23222 

A 

1 

22 

52 

1.92 

0.27 

0.70 

0.65 

23222 

B 

0 

4 

10 

0.12 

0.20 

0.48 

-0.24 

23222 

C 

0 

9 

21 

0.32 

0.29 

0.75 

-0.30 

23222 

D 

0 

7 

17 

0.06 

0.24 

0.50 

-0.35 

23223 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

23223 

A 

1 

28 

61 

1.99 

0.33 

1.62 

0.41 

23223 

B 

0 

7 

15 

1.04 

0.46 

1.84 

-0.11 

23223 

C 

0 

8 

17 

0.56 

0.25 

0.74 

-0.26 

23223 

D 

0 

3 

7 

-0.14 

0.35 

0.33 

-0.26 

23224 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23224 

A 

1 

37 

82 

1.62 

0.20 

1.31 

0.41 

23224 

B 

0 

2 

4 

1.05 

0.64 

1.31 

-0.06 

23224 

C 

0 

2 

4 

-0.05 

0.75 

0.47 

-0.25 

23224 

D 

0 

4 

9 

0.08 

0.37 

0.49 

-0.33 

23225 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23225 

A 

1 

29 

63 

1.84 

0.28 

1.13 

0.39 

23225 

B 

0 

4 

9 

1.56 

0.43 

2.22 

0.04 

23225 

C 

0 

10 

22 

0.29 

0.43 

0.97 

-0.38 

23225 

D 

0 

3 

7 

0.39 

0.57 

0.67 

-0.17 

23226 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.00 

23226 

A 

1 

30 

70 

1.75 

0.25 

1.12 

0.26 

23226 

B 

0 

4 

9 

0.56 

0.89 

1.10 

-0.20 

23226 

C 

0 

6 

14 

1.95 

0.48 

3.40 

0.12 

23226 

D 

0 

3 

7 

-0.66 

0.80 

0.32 

-0.40 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23227 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

23227 

A 

1 

17 

38 

1.61 

0.34 

1.66 

0.22 

23227 

B 

0 

10 

22 

0.81 

0.50 

1.72 

-0.11 

23227 

C 

0 

14 

31 

1.52 

0.33 

2.17 

0.16 

23227 

D 

0 

4 

9 

-1.22 

0.89 

0.14 

-0.47 

23228 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23228 

A 

1 

12 

26 

2.51 

0.46 

1.37 

0.34 

23228 

B 

0 

25 

54 

1.67 

0.28 

1.61 

0.03 

23228 

C 

0 

5 

11 

0.24 

0.48 

0.30 

-0.32 

23228 

D 

0 

4 

9 

0.53 

0.65 

0.36 

-0.22 

23229 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23229 

A 

1 

31 

69 

2.46 

0.22 

0.68 

0.65 

23229 

B 

0 

7 

16 

1.08 

0.33 

1.01 

-0.20 

23229 

C 

0 

2 

4 

-0.58 

0.44 

0.16 

-0.33 

23229 

D 

0 

5 

11 

-0.41 

0.42 

0.22 

-0.51 

23230 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23230 

A 

1 

22 

49 

2.61 

0.23 

0.61 

0.66 

23230 

B 

0 

7 

16 

0.52 

0.63 

0.90 

-0.35 

23230 

C 

0 

11 

24 

1.00 

0.20 

0.67 

-0.27 

23230 

D 

0 

5 

11 

0.54 

0.42 

0.49 

-0.28 

23231 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23231 

A 

1 

33 

75 

1.60 

0.24 

1.03 

0.33 

23231 

B 

0 

8 

18 

0.65 

0.45 

1.29 

-0.23 

23231 

C 

0 

2 

5 

0.08 

0.51 

0.49 

-0.20 

23231 

D 

0 

1 

2 

0.63 

0.00 

0.75 

-0.08 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23232 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23232 

A 

1 

32 

73 

1.68 

0.17 

0.91 

0.46 

23232 

B 

0 

3 

7 

1.25 

0.76 

1.63 

-0.03 

23232 

C 

0 

7 

16 

0.60 

0.30 

0.76 

-0.31 

23232 

D 

0 

2 

5 

-0.58 

0.82 

0.24 

-0.40 

23233 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23233 

A 

1 

31 

69 

2.20 

0.26 

1.34 

0.44 

23233 

B 

0 

5 

11 

0.46 

0.46 

0.57 

-0.32 

23233 

C 

0 

3 

7 

1.26 

0.54 

1.12 

-0.09 

23233 

D 

0 

6 

13 

0.90 

0.50 

1.38 

-0.23 

23234 

* 

-1 

3950 

99 

1.52 

0.02 

0.00 

0.02 

23234 

A 

1 

19 

45 

1.79 

0.29 

1.34 

0.43 

23234 

B 

0 

8 

19 

0.73 

0.30 

0.82 

-0.16 

23234 

C 

0 

14 

33 

0.71 

0.36 

1.25 

-0.25 

23234 

D 

0 

1 

2 

-0.89 

0.00 

0.12 

-0.24 

23235 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23235 

A 

1 

26 

59 

1.76 

0.33 

1.27 

0.38 

23235 

B 

0 

9 

20 

0.61 

0.40 

1.27 

-0.17 

23235 

C 

0 

4 

9 

1.34 

0.70 

2.66 

0.03 

23235 

D 

0 

5 

11 

-0.76 

0.97 

0.70 

-0.40 

23236 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23236 

A 

1 

41 

91 

1.65 

0.24 

0.89 

0.36 

23236 

B 

0 

2 

4 

-0.51 

1.56 

0.87 

-0.27 

23236 

C 

0 

2 

4 

-0.22 

1.20 

0.84 

-0.23 

23236 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23237 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.03 

23237 

A 

1 

38 

86 

2.09 

0.27 

1.07 

0.33 

23237 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23237 

C 

0 

3 

7 

0.23 

1.22 

1.99 

-0.27 

23237 

D 

0 

3 

7 

0.76 

0.53 

1.06 

-0.18 

23238 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23238 

A 

1 

38 

84 

2.03 

0.27 

0.99 

0.43 

23238 

B 

0 

2 

4 

-0.25 

0.50 

0.36 

-0.24 

23238 

C 

0 

3 

7 

0.62 

0.39 

0.90 

-0.17 

23238 

D 

0 

2 

4 

-0.83 

1.17 

0.32 

-0.32 

23239 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.04 

23239 

A 

1 

40 

87 

1.15 

0.17 

0.90 

0.45 

23239 

B 

0 

1 

2 

-0.23 

0.00 

0.48 

-0.14 

23239 

C 

0 

4 

9 

-0.75 

0.79 

0.48 

-0.43 

23239 

D 

0 

1 

2 

0.47 

0.00 

0.97 

-0.06 

23240 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23240 

A 

1 

32 

71 

2.00 

0.25 

0.81 

0.56 

23240 

B 

0 

3 

7 

-0.71 

0.76 

0.34 

-0.37 

23240 

C 

0 

6 

13 

-0.11 

0.36 

0.50 

-0.39 

23240 

D 

0 

4 

9 

0.88 

0.33 

1.14 

-0.11 

23241 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.05 

23241 

A 

1 

33 

75 

1.20 

0.31 

1.14 

0.35 

23241 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23241 

C 

0 

5 

11 

0.41 

0.47 

1.80 

-0.09 

23241 

D 

0 

6 

14 

-0.68 

0.44 

0.74 

-0.35 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23242 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23242 

A 

1 

36 

80 

2.14 

0.22 

0.86 

0.47 

23242 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23242 

C 

0 

4 

9 

-0.04 

0.44 

0.38 

-0.40 

23242 

D 

0 

5 

11 

0.86 

0.61 

1.21 

-0.23 

23243 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23243 

A 

1 

9 

20 

2.83 

0.49 

1.01 

0.42 

23243 

B 

0 

9 

20 

0.97 

0.58 

0.91 

-0.17 

23243 

C 

0 

20 

44 

1.72 

0.27 

1.49 

0.12 

23243 

D 

0 

7 

16 

-0.15 

0.35 

0.17 

-0.45 

23244 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

23244 

A 

1 

35 

78 

1.39 

0.20 

1.17 

0.37 

23244 

B 

0 

2 

4 

0.05 

0.18 

0.45 

-0.22 

23244 

C 

0 

4 

9 

0.57 

0.23 

0.81 

-0.17 

23244 

D 

0 

4 

9 

0.40 

0.11 

0.64 

-0.21 

23245 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

23245 

A 

1 

36 

80 

1.47 

0.27 

0.99 

0.37 

23245 

B 

0 

4 

9 

-0.26 

0.96 

0.94 

-0.26 

23245 

C 

0 

1 

2 

-0.30 

0.00 

0.45 

-0.13 

23245 

D 

0 

4 

9 

0.11 

0.90 

1.71 

-0.19 

23246 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

23246 

A 

1 

37 

84 

1.71 

0.27 

1.66 

0.09 

23246 

B 

0 

4 

9 

1.52 

0.47 

2.60 

-0.03 

23246 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23246 

D 

0 

3 

7 

1.04 

1.73 

11.23 

-0.10 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23247 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23247 

A 

1 

26 

58 

1.84 

0.19 

0.71 

0.58 

23247 

B 

0 

3 

7 

0.52 

1.03 

1.04 

-0.16 

23247 

C 

0 

14 

31 

0.43 

0.26 

0.76 

-0.46 

23247 

D 

0 

2 

4 

0.42 

0.24 

0.50 

-0.15 

23248 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23248 

A 

1 

40 

91 

1.54 

0.19 

0.88 

0.30 

23248 

B 

0 

1 

2 

1.11 

0.00 

1.30 

-0.04 

23248 

C 

0 

1 

2 

1.21 

0.00 

1.44 

-0.02 

23248 

D 

0 

2 

5 

-0.78 

2.03 

0.77 

-0.37 

23249 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23249 

A 

1 

32 

71 

1.71 

0.21 

0.79 

0.51 

23249 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23249 

C 

0 

8 

18 

-0.02 

0.51 

0.96 

-0.42 

23249 

D 

0 

5 

11 

0.31 

0.66 

1.14 

-0.23 

23250 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

23250 

A 

1 

40 

87 

1.40 

0.19 

0.76 

0.51 

23250 

B 

0 

3 

7 

-1.26 

0.17 

0.19 

-0.44 

23250 

C 

0 

2 

4 

0.67 

2.02 

4.97 

-0.07 

23250 

D 

0 

1 

2 

-2.11 

0.00 

0.08 

-0.33 

23251 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23251 

A 

1 

32 

71 

2.19 

0.26 

0.99 

0.38 

23251 

B 

0 

6 

13 

-0.06 

0.65 

0.66 

-0.47 

23251 

C 

0 

4 

9 

2.08 

0.17 

2.30 

0.05 

23251 

D 

0 

3 

7 

1.17 

0.58 

1.22 

-0.11 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23252 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23252 

A 

1 

16 

36 

2.77 

0.43 

1.04 

0.57 

23252 

B 

0 

4 

9 

1.35 

0.69 

1.90 

-0.03 

23252 

C 

0 

22 

49 

0.83 

0.23 

0.90 

-0.42 

23252 

D 

0 

3 

7 

0.16 

0.86 

0.50 

-0.22 

23253 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23253 

A 

1 

39 

87 

1.55 

0.24 

1.00 

0.31 

23253 

B 

0 

1 

2 

0.71 

0.00 

1.05 

-0.07 

23253 

C 

0 

1 

2 

-0.65 

0.00 

0.27 

-0.20 

23253 

D 

0 

4 

9 

0.27 

0.64 

1.07 

-0.23 

23254 

* 

-1 

3942 

99 

1.52 

0.02 

0.00 

0.01 

23254 

A 

1 

34 

68 

1.82 

0.29 

1.63 

0.41 

23254 

B 

0 

7 

14 

0.74 

0.60 

2.40 

-0.13 

23254 

C 

0 

4 

8 

0.41 

0.69 

1.20 

-0.15 

23254 

D 

0 

5 

10 

-0.50 

0.58 

0.40 

-0.35 

23255 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

23255 

A 

1 

37 

84 

1.40 

0.20 

0.82 

0.50 

23255 

B 

0 

3 

7 

-0.50 

0.64 

0.48 

-0.34 

23255 

C 

0 

2 

5 

0.17 

0.84 

0.87 

-0.16 

23255 

D 

0 

2 

5 

-0.69 

0.30 

0.28 

-0.30 

23256 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23256 

A 

1 

24 

53 

2.19 

0.28 

0.87 

0.55 

23256 

B 

0 

12 

27 

1.03 

0.33 

1.21 

-0.13 

23256 

C 

0 

5 

11 

-0.15 

0.43 

0.32 

-0.34 

23256 

D 

0 

4 

9 

-0.51 

0.63 

0.26 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23257 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23257 

A 

1 

23 

51 

1.57 

0.27 

1.70 

0.31 

23257 

B 

0 

7 

16 

0.50 

0.40 

0.73 

-0.24 

23257 

C 

0 

12 

27 

0.93 

0.34 

1.39 

-0.12 

23257 

D 

0 

3 

7 

0.87 

0.80 

1.39 

-0.07 

23258 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

23258 

A 

1 

38 

83 

1.72 

0.19 

0.97 

0.38 

23258 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23258 

C 

0 

3 

7 

0.63 

0.12 

0.64 

-0.19 

23258 

D 

0 

5 

11 

0.45 

0.65 

1.15 

-0.31 

23259 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23259 

A 

1 

34 

76 

1.53 

0.26 

1.49 

0.35 

23259 

B 

0 

2 

4 

0.35 

0.66 

0.79 

-0.14 

23259 

C 

0 

4 

9 

0.38 

0.37 

0.81 

-0.19 

23259 

D 

0 

5 

11 

0.38 

0.32 

0.84 

-0.22 

23260 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

23260 

A 

1 

25 

57 

1.60 

0.26 

1.06 

0.34 

23260 

B 

0 

6 

14 

0.57 

0.69 

1.96 

-0.15 

23260 

C 

0 

9 

20 

0.95 

0.60 

4.53 

-0.06 

23260 

D 

0 

4 

9 

-0.44 

0.85 

0.56 

-0.32 

23261 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23261 

A 

1 

32 

73 

1.57 

0.22 

1.17 

0.42 

23261 

B 

0 

4 

9 

0.96 

0.37 

1.18 

-0.08 

23261 

C 

0 

6 

14 

0.46 

0.30 

0.71 

-0.26 

23261 

D 

0 

2 

5 

-0.74 

0.45 

0.20 

-0.36 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23262 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23262 

A 

1 

32 

71 

2.11 

0.23 

0.99 

0.48 

23262 

B 

0 

6 

13 

0.63 

0.34 

0.67 

-0.31 

23262 

C 

0 

4 

9 

0.40 

0.71 

0.74 

-0.30 

23262 

D 

0 

3 

7 

1.07 

0.49 

0.98 

-0.12 

23263 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.00 

23263 

A 

1 

25 

54 

2.11 

0.27 

1.11 

0.42 

23263 

B 

0 

15 

33 

1.11 

0.39 

1.67 

-0.20 

23263 

C 

0 

2 

4 

0.68 

0.81 

0.64 

-0.12 

23263 

D 

0 

4 

9 

-0.05 

0.50 

0.35 

-0.33 

23264 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23264 

A 

1 

19 

42 

2.12 

0.33 

1.18 

0.43 

23264 

B 

0 

15 

33 

0.65 

0.31 

0.83 

-0.34 

23264 

C 

0 

8 

18 

1.18 

0.62 

3.58 

-0.06 

23264 

D 

0 

3 

7 

0.67 

0.42 

0.57 

-0.13 

23265 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23265 

A 

1 

25 

56 

2.45 

0.26 

0.68 

0.62 

23265 

B 

0 

15 

33 

0.38 

0.34 

1.57 

-0.50 

23265 

C 

0 

3 

7 

0.93 

1.32 

2.26 

-0.10 

23265 

D 

0 

2 

4 

-0.19 

0.01 

0.24 

-0.23 

23266 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

23266 

A 

1 

34 

77 

1.84 

0.21 

1.18 

0.27 

23266 

B 

0 

4 

9 

1.48 

0.83 

3.81 

-0.05 

23266 

C 

0 

5 

11 

0.68 

0.38 

0.81 

-0.28 

23266 

D 

0 

1 

2 

1.03 

0.00 

0.79 

-0.08 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23267 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23267 

A 

1 

20 

44 

2.31 

0.30 

1.39 

0.44 

23267 

B 

0 

16 

36 

1.33 

0.27 

1.17 

-0.17 

23267 

C 

0 

6 

13 

1.06 

0.49 

0.85 

-0.17 

23267 

D 

0 

3 

7 

0.04 

0.62 

0.25 

-0.32 

23268 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.03 

23268 

A 

1 

19 

43 

2.57 

0.42 

2.02 

0.38 

23268 

B 

0 

11 

25 

1.39 

0.45 

1.83 

-0.18 

23268 

C 

0 

12 

27 

1.42 

0.30 

0.99 

-0.18 

23268 

D 

0 

2 

5 

0.66 

0.59 

0.37 

-0.17 

23269 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23269 

A 

1 

28 

61 

1.84 

0.26 

1.04 

0.42 

23269 

B 

0 

12 

26 

0.68 

0.32 

1.31 

-0.29 

23269 

C 

0 

3 

7 

0.40 

0.25 

0.53 

-0.18 

23269 

D 

0 

3 

7 

0.70 

1.23 

2.80 

-0.13 

23270 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23270 

A 

1 

11 

24 

2.25 

0.49 

1.37 

0.33 

23270 

B 

0 

31 

67 

1.29 

0.21 

1.16 

-0.16 

23270 

C 

0 

1 

2 

2.08 

0.00 

1.49 

0.07 

23270 

D 

0 

3 

7 

-0.15 

0.57 

0.23 

-0.31 

23271 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23271 

A 

1 

9 

20 

3.11 

0.56 

1.32 

0.48 

23271 

B 

0 

25 

56 

1.72 

0.24 

1.27 

0.06 

23271 

C 

0 

7 

16 

0.47 

0.37 

0.27 

-0.33 

23271 

D 

0 

4 

9 

-0.22 

0.35 

0.12 

-0.38 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23272 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23272 

A 

1 

14 

31 

1.76 

0.48 

4.53 

0.11 

23272 

B 

0 

20 

44 

1.54 

0.29 

1.63 

0.03 

23272 

C 

0 

9 

20 

1.26 

0.60 

1.78 

-0.08 

23272 

D 

0 

2 

4 

0.34 

0.33 

0.25 

-0.16 

23273 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23273 

A 

1 

2 

4 

0.58 

0.54 

5.62 

-0.12 

23273 

B 

0 

28 

62 

1.92 

0.23 

1.52 

0.45 

23273 

C 

0 

12 

27 

1.03 

0.29 

0.53 

-0.15 

23273 

D 

0 

3 

7 

-1.39 

1.46 

0.08 

-0.50 

23274 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

0.00 

23274 

A 

1 

21 

46 

2.68 

0.35 

1.09 

0.58 

23274 

B 

0 

11 

24 

-0.03 

0.45 

1.02 

-0.51 

23274 

C 

0 

13 

28 

1.06 

0.26 

0.87 

-0.18 

23274 

D 

0 

1 

2 

2.48 

0.00 

2.55 

0.08 

23275 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23275 

A 

1 

39 

85 

1.62 

0.21 

0.76 

0.50 

23275 

B 

0 

5 

11 

-0.82 

0.31 

0.26 

-0.52 

23275 

C 

0 

2 

4 

0.78 

1.12 

1.82 

-0.08 

23275 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23276 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.02 

23276 

A 

1 

25 

58 

2.36 

0.26 

0.87 

0.50 

23276 

B 

0 

8 

19 

0.70 

0.38 

0.68 

-0.39 

23276 

C 

0 

8 

19 

1.03 

0.39 

0.82 

-0.27 

23276 

D 

0 

2 

5 

2.12 

0.24 

1.71 

0.05 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23277 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23277 

A 

1 

28 

62 

1.82 

0.36 

8.50 

0.21 

23277 

B 

0 

5 

11 

1.27 

0.34 

1.18 

-0.06 

23277 

C 

0 

10 

22 

1.22 

0.45 

2.34 

-0.10 

23277 

D 

0 

2 

4 

0.03 

0.69 

0.36 

-0.20 

23278 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23278 

A 

1 

26 

58 

2.03 

0.24 

0.78 

0.64 

23278 

B 

0 

7 

16 

0.35 

0.38 

0.65 

-0.26 

23278 

C 

0 

8 

18 

-0.09 

0.32 

0.43 

-0.42 

23278 

D 

0 

4 

9 

0.17 

0.76 

0.88 

-0.22 

23279 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.04 

23279 

A 

1 

26 

57 

1.55 

0.26 

1.14 

0.43 

23279 

B 

0 

11 

24 

0.53 

0.35 

1.28 

-0.22 

23279 

C 

0 

6 

13 

-0.04 

0.28 

0.51 

-0.31 

23279 

D 

0 

3 

7 

0.69 

0.72 

1.39 

-0.07 

23280 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

23280 

A 

1 

19 

42 

2.14 

0.26 

0.54 

0.69 

23280 

B 

0 

8 

18 

-0.01 

0.47 

0.96 

-0.33 

23280 

C 

0 

12 

27 

0.23 

0.30 

0.74 

-0.32 

23280 

D 

0 

6 

13 

0.19 

0.20 

0.50 

-0.22 

23281 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23281 

A 

1 

40 

89 

1.87 

0.26 

0.86 

0.36 

23281 

B 

0 

4 

9 

0.50 

0.57 

1.46 

-0.21 

23281 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23281 

D 

0 

1 

2 

-2.64 

0.00 

0.04 

-0.37 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23282 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23282 

A 

1 

34 

77 

1.73 

0.21 

0.72 

0.61 

23282 

B 

0 

5 

11 

0.21 

0.48 

0.89 

-0.25 

23282 

C 

0 

2 

5 

-0.31 

0.48 

0.39 

-0.23 

23282 

D 

0 

3 

7 

-1.59 

0.20 

0.10 

-0.51 

23283 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.02 

23283 

A 

1 

36 

82 

2.15 

0.25 

0.85 

0.54 

23283 

B 

0 

2 

5 

0.85 

0.32 

0.98 

-0.12 

23283 

C 

0 

5 

11 

-0.32 

0.36 

0.38 

-0.45 

23283 

D 

0 

1 

2 

-1.27 

0.00 

0.11 

-0.28 

23284 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

23284 

A 

1 

34 

77 

2.09 

0.21 

0.78 

0.50 

23284 

B 

0 

6 

14 

0.77 

0.65 

1.63 

-0.25 

23284 

C 

0 

2 

5 

0.32 

1.08 

0.67 

-0.20 

23284 

D 

0 

2 

5 

-0.90 

0.34 

0.13 

-0.39 

23285 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23285 

A 

1 

14 

31 

2.07 

0.50 

1.89 

0.39 

23285 

B 

0 

14 

31 

0.73 

0.28 

0.90 

-0.26 

23285 

C 

0 

12 

27 

1.05 

0.23 

0.90 

-0.10 

23285 

D 

0 

5 

11 

1.09 

0.58 

1.21 

-0.05 

23286 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23286 

A 

1 

15 

33 

2.14 

0.42 

2.60 

0.21 

23286 

B 

0 

16 

36 

1.02 

0.23 

0.55 

-0.41 

23286 

C 

0 

13 

29 

2.18 

0.33 

2.32 

0.20 

23286 

D 

0 

1 

2 

2.16 

0.00 

1.18 

0.05 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23287 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

23287 

A 

1 

31 

69 

1.91 

0.29 

1.23 

0.32 

23287 

B 

0 

2 

4 

-0.30 

0.28 

0.27 

-0.25 

23287 

C 

0 

10 

22 

1.38 

0.38 

2.85 

-0.06 

23287 

D 

0 

2 

4 

-1.12 

0.93 

0.17 

-0.35 

23288 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.04 

23288 

A 

1 

27 

61 

1.48 

0.19 

0.88 

0.58 

23288 

B 

0 

11 

25 

0.08 

0.25 

0.64 

-0.43 

23288 

C 

0 

3 

7 

0.74 

0.65 

1.27 

-0.05 

23288 

D 

0 

3 

7 

-0.50 

0.52 

0.34 

-0.33 

23289 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23289 

A 

1 

35 

76 

1.68 

0.25 

1.04 

0.40 

23289 

B 

0 

6 

13 

0.33 

0.53 

1.44 

-0.24 

23289 

C 

0 

2 

4 

0.61 

2.62 

6.22 

-0.10 

23289 

D 

0 

3 

7 

-0.37 

0.33 

0.38 

-0.28 

23290 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23290 

A 

1 

36 

80 

1.81 

0.22 

0.73 

0.56 

23290 

B 

0 

4 

9 

0.34 

0.50 

0.97 

-0.16 

23290 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23290 

D 

0 

5 

11 

-1.63 

1.17 

0.47 

-0.57 

23291 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23291 

A 

1 

20 

44 

2.06 

0.36 

1.81 

0.36 

23291 

B 

0 

14 

31 

1.49 

0.31 

2.12 

0.03 

23291 

C 

0 

9 

20 

0.08 

0.57 

1.94 

-0.42 

23291 

D 

0 

2 

4 

0.48 

0.46 

0.45 

-0.13 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23292 

* 

-1 

3940 

99 

1.52 

0.02 

0.00 

0.00 

23292 

A 

1 

30 

58 

2.02 

0.26 

1.39 

0.44 

23292 

B 

0 

7 

13 

0.12 

0.26 

0.38 

-0.36 

23292 

C 

0 

11 

21 

0.93 

0.36 

1.06 

-0.19 

23292 

D 

0 

4 

8 

1.16 

1.01 

2.62 

-0.06 

23293 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

23293 

A 

1 

31 

70 

1.67 

0.22 

1.52 

0.27 

23293 

B 

0 

7 

16 

0.86 

0.26 

0.88 

-0.23 

23293 

C 

0 

3 

7 

1.09 

0.84 

1.42 

-0.09 

23293 

D 

0 

3 

7 

1.17 

0.33 

1.06 

-0.07 

23294 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23294 

A 

1 

24 

53 

2.85 

0.28 

0.57 

0.71 

23294 

B 

0 

7 

16 

0.06 

0.30 

0.31 

-0.43 

23294 

C 

0 

12 

27 

0.79 

0.30 

0.78 

-0.34 

23294 

D 

0 

2 

4 

-0.02 

0.49 

0.25 

-0.23 

23295 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23295 

A 

1 

16 

36 

1.45 

0.45 

4.19 

0.06 

23295 

B 

0 

20 

45 

1.15 

0.22 

1.02 

-0.13 

23295 

C 

0 

5 

11 

1.79 

0.55 

2.18 

0.12 

23295 

D 

0 

3 

7 

1.21 

0.35 

0.85 

-0.03 

23296 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23296 

A 

1 

27 

60 

1.97 

0.27 

1.15 

0.49 

23296 

B 

0 

5 

11 

0.59 

0.24 

0.63 

-0.21 

23296 

C 

0 

9 

20 

0.61 

0.32 

0.79 

-0.29 

23296 

D 

0 

4 

9 

0.55 

0.65 

0.92 

-0.20 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23297 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23297 

A 

1 

29 

63 

2.16 

0.32 

1.89 

0.39 

23297 

B 

0 

5 

11 

1.41 

0.59 

1.91 

-0.05 

23297 

C 

0 

7 

15 

0.85 

0.40 

0.98 

-0.21 

23297 

D 

0 

5 

11 

0.20 

0.51 

0.52 

-0.31 

23298 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23298 

A 

1 

21 

46 

2.59 

0.35 

1.08 

0.55 

23298 

B 

0 

6 

13 

1.17 

0.58 

1.30 

-0.10 

23298 

C 

0 

14 

30 

0.70 

0.30 

0.78 

-0.35 

23298 

D 

0 

5 

11 

0.36 

0.68 

0.66 

-0.26 

23299 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

23299 

A 

1 

21 

47 

1.53 

0.26 

1.13 

0.40 

23299 

B 

0 

10 

22 

0.44 

0.29 

0.80 

-0.26 

23299 

C 

0 

12 

27 

0.56 

0.28 

0.95 

-0.24 

23299 

D 

0 

2 

4 

1.38 

1.11 

2.38 

0.07 

23300 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23300 

A 

1 

23 

51 

1.99 

0.28 

1.00 

0.42 

23300 

B 

0 

9 

20 

0.84 

0.44 

1.41 

-0.23 

23300 

C 

0 

9 

20 

1.33 

0.30 

1.67 

-0.04 

23300 

D 

0 

4 

9 

-0.12 

0.37 

0.30 

-0.36 

23301 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.06 

23301 

A 

1 

29 

64 

2.73 

0.25 

1.22 

0.41 

23301 

B 

0 

5 

11 

1.13 

0.23 

0.47 

-0.30 

23301 

C 

0 

9 

20 

2.07 

0.43 

2.11 

-0.08 

23301 

D 

0 

2 

4 

0.07 

0.35 

0.16 

-0.34 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23302 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23302 

A 

1 

19 

42 

2.40 

0.42 

1.60 

0.41 

23302 

B 

0 

15 

33 

1.35 

0.24 

1.25 

-0.16 

23302 

C 

0 

8 

18 

0.56 

0.32 

0.56 

-0.35 

23302 

D 

0 

3 

7 

1.86 

0.35 

1.66 

0.03 

23303 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23303 

A 

1 

23 

50 

1.74 

0.29 

1.69 

0.33 

23303 

B 

0 

4 

9 

0.60 

0.34 

0.59 

-0.18 

23303 

C 

0 

17 

37 

0.90 

0.25 

1.03 

-0.27 

23303 

D 

0 

2 

4 

1.79 

0.66 

2.02 

0.08 

23304 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

23304 

A 

1 

26 

59 

2.60 

0.28 

0.63 

0.66 

23304 

B 

0 

5 

11 

0.93 

0.84 

2.80 

-0.14 

23304 

C 

0 

10 

23 

-0.13 

0.32 

0.41 

-0.53 

23304 

D 

0 

3 

7 

0.06 

0.42 

0.38 

-0.23 

23305 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23305 

A 

1 

21 

48 

2.73 

0.39 

0.98 

0.62 

23305 

B 

0 

8 

18 

0.41 

0.41 

0.75 

-0.23 

23305 

C 

0 

9 

20 

0.64 

0.38 

0.87 

-0.19 

23305 

D 

0 

6 

14 

-0.69 

0.84 

0.45 

-0.41 

23306 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23306 

A 

1 

29 

64 

1.78 

0.34 

2.27 

0.25 

23306 

B 

0 

10 

22 

0.95 

0.41 

1.55 

-0.17 

23306 

C 

0 

2 

4 

0.60 

1.17 

1.08 

-0.12 

23306 

D 

0 

4 

9 

1.06 

0.36 

1.16 

-0.08 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23307 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23307 

A 

1 

11 

24 

2.48 

0.59 

3.06 

0.24 

23307 

B 

0 

9 

20 

0.77 

0.32 

0.33 

-0.36 

23307 

C 

0 

22 

49 

1.95 

0.30 

1.71 

0.06 

23307 

D 

0 

3 

7 

2.16 

0.58 

1.27 

0.05 

23308 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

23308 

A 

1 

22 

50 

2.11 

0.33 

1.36 

0.41 

23308 

B 

0 

6 

14 

1.57 

0.60 

3.42 

0.02 

23308 

C 

0 

14 

32 

0.79 

0.25 

0.79 

-0.33 

23308 

D 

0 

2 

5 

-0.38 

1.04 

0.28 

-0.28 

23309 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.03 

23309 

A 

1 

9 

21 

0.28 

0.45 

6.59 

-0.29 

23309 

B 

0 

17 

40 

1.77 

0.29 

2.86 

0.42 

23309 

C 

0 

12 

28 

0.90 

0.36 

1.00 

-0.07 

23309 

D 

0 

5 

12 

0.38 

0.73 

1.12 

-0.18 

23310 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23310 

A 

1 

16 

36 

2.27 

0.41 

1.85 

0.37 

23310 

B 

0 

15 

33 

1.41 

0.32 

1.53 

-0.09 

23310 

C 

0 

11 

24 

1.03 

0.31 

0.79 

-0.23 

23310 

D 

0 

3 

7 

0.95 

0.14 

0.50 

-0.12 

23311 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23311 

A 

1 

11 

24 

1.99 

0.65 

3.68 

0.17 

23311 

B 

0 

8 

18 

1.72 

0.70 

3.11 

0.06 

23311 

C 

0 

22 

49 

1.60 

0.18 

1.11 

0.06 

23311 

D 

0 

4 

9 

-0.90 

0.57 

0.12 

-0.46 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23312 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

23312 

A 

1 

17 

39 

2.32 

0.41 

1.01 

0.55 

23312 

B 

0 

10 

23 

0.36 

0.52 

0.86 

-0.20 

23312 

C 

0 

13 

30 

0.58 

0.27 

0.85 

-0.16 

23312 

D 

0 

4 

9 

-1.24 

1.15 

0.30 

-0.39 

23313 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23313 

A 

1 

14 

31 

2.01 

0.51 

2.35 

0.25 

23313 

B 

0 

12 

27 

1.26 

0.43 

1.95 

-0.08 

23313 

C 

0 

13 

29 

1.23 

0.31 

1.22 

-0.09 

23313 

D 

0 

6 

13 

1.02 

0.45 

0.91 

-0.11 

23314 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23314 

A 

1 

21 

46 

1.91 

0.31 

1.49 

0.21 

23314 

B 

0 

10 

22 

0.98 

0.38 

1.10 

-0.25 

23314 

C 

0 

12 

26 

1.71 

0.37 

2.19 

0.05 

23314 

D 

0 

3 

7 

1.09 

0.25 

0.69 

-0.10 

23315 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.01 

23315 

A 

1 

21 

49 

2.64 

0.38 

1.39 

0.53 

23315 

B 

0 

8 

19 

1.52 

0.37 

1.82 

-0.03 

23315 

C 

0 

7 

16 

0.21 

0.40 

0.44 

-0.34 

23315 

D 

0 

7 

16 

0.11 

0.71 

0.70 

-0.36 

23316 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23316 

A 

1 

19 

43 

2.41 

0.33 

0.97 

0.60 

23316 

B 

0 

14 

32 

0.71 

0.28 

0.78 

-0.33 

23316 

C 

0 

7 

16 

0.34 

0.36 

0.51 

-0.32 

23316 

D 

0 

4 

9 

0.96 

0.38 

0.86 

-0.10 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23317 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23317 

A 

1 

25 

56 

1.85 

0.28 

1.30 

0.42 

23317 

B 

0 

4 

9 

0.71 

0.71 

1.06 

-0.15 

23317 

C 

0 

12 

27 

0.77 

0.31 

0.93 

-0.26 

23317 

D 

0 

4 

9 

0.59 

0.47 

0.68 

-0.18 

23318 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.02 

23318 

A 

1 

29 

67 

2.55 

0.30 

0.88 

0.59 

23318 

B 

0 

3 

7 

-0.36 

0.85 

0.39 

-0.33 

23318 

C 

0 

9 

21 

0.70 

0.41 

1.14 

-0.32 

23318 

D 

0 

2 

5 

-0.55 

0.19 

0.17 

-0.29 

23319 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23319 

A 

1 

19 

42 

2.12 

0.31 

1.05 

0.53 

23319 

B 

0 

7 

16 

-0.38 

0.54 

0.48 

-0.50 

23319 

C 

0 

13 

29 

1.24 

0.18 

1.06 

-0.01 

23319 

D 

0 

6 

13 

0.49 

0.20 

0.46 

-0.22 

23320 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23320 

A 

1 

26 

58 

2.52 

0.25 

1.27 

0.61 

23320 

B 

0 

12 

27 

1.03 

0.38 

1.00 

-0.26 

23320 

C 

0 

4 

9 

-0.29 

0.21 

0.16 

-0.40 

23320 

D 

0 

3 

7 

0.00 

0.57 

0.27 

-0.29 

23321 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23321 

A 

1 

22 

49 

2.40 

0.28 

0.89 

0.59 

23321 

B 

0 

11 

24 

0.53 

0.40 

0.96 

-0.38 

23321 

C 

0 

7 

16 

0.75 

0.41 

0.73 

-0.22 

23321 

D 

0 

5 

11 

0.84 

0.34 

0.67 

-0.16 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23322 

* 

-1 

3950 

99 

1.51 

0.02 

0.00 

-0.01 

23322 

A 

1 

21 

50 

2.65 

0.34 

1.09 

0.56 

23322 

B 

0 

11 

26 

1.02 

0.26 

0.85 

-0.19 

23322 

C 

0 

4 

10 

0.81 

0.80 

1.00 

-0.14 

23322 

D 

0 

6 

14 

-0.33 

0.96 

0.71 

-0.43 

23323 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23323 

A 

1 

26 

58 

2.09 

0.27 

1.29 

0.39 

23323 

B 

0 

9 

20 

0.64 

0.26 

0.56 

-0.38 

23323 

C 

0 

8 

18 

1.52 

0.32 

1.55 

-0.05 

23323 

D 

0 

2 

4 

0.92 

1.44 

1.29 

-0.12 

23324 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23324 

A 

1 

28 

62 

2.06 

0.33 

1.36 

0.46 

23324 

B 

0 

10 

22 

0.20 

0.29 

0.60 

-0.40 

23324 

C 

0 

6 

13 

0.83 

0.44 

1.27 

-0.15 

23324 

D 

0 

1 

2 

1.00 

0.00 

0.97 

-0.04 

23325 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23325 

A 

1 

27 

60 

1.83 

0.23 

1.05 

0.42 

23325 

B 

0 

10 

22 

1.01 

0.38 

1.56 

-0.13 

23325 

C 

0 

6 

13 

0.59 

0.70 

2.13 

-0.21 

23325 

D 

0 

2 

4 

-1.11 

1.02 

0.15 

-0.38 

23326 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

23326 

A 

1 

25 

57 

2.04 

0.31 

1.49 

0.32 

23326 

B 

0 

7 

16 

0.42 

0.46 

0.66 

-0.34 

23326 

C 

0 

10 

23 

1.84 

0.36 

3.02 

0.08 

23326 

D 

0 

2 

5 

-0.58 

0.75 

0.19 

-0.31 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23327 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

23327 

A 

1 

26 

58 

1.84 

0.31 

1.09 

0.50 

23327 

B 

0 

9 

20 

0.59 

0.29 

0.95 

-0.17 

23327 

C 

0 

7 

16 

0.54 

0.26 

0.81 

-0.16 

23327 

D 

0 

3 

7 

-1.85 

0.84 

0.14 

-0.49 

23328 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

0.00 

23328 

A 

1 

24 

52 

2.09 

0.28 

1.58 

0.39 

23328 

B 

0 

11 

24 

1.27 

0.39 

1.82 

-0.13 

23328 

C 

0 

8 

17 

0.80 

0.33 

0.70 

-0.26 

23328 

D 

0 

3 

7 

0.66 

1.25 

1.73 

-0.18 

23329 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23329 

A 

1 

26 

58 

1.90 

0.29 

1.37 

0.41 

23329 

B 

0 

7 

16 

0.51 

0.25 

0.61 

-0.28 

23329 

C 

0 

8 

18 

1.19 

0.26 

1.18 

-0.07 

23329 

D 

0 

4 

9 

0.20 

0.82 

0.71 

-0.27 

23330 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23330 

A 

1 

25 

56 

2.18 

0.29 

1.38 

0.54 

23330 

B 

0 

7 

16 

0.72 

0.43 

0.94 

-0.18 

23330 

C 

0 

9 

20 

0.14 

0.40 

0.60 

-0.39 

23330 

D 

0 

4 

9 

0.52 

0.95 

1.45 

-0.17 

23331 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23331 

A 

1 

38 

84 

1.53 

0.23 

0.98 

0.38 

23331 

B 

0 

4 

9 

-0.04 

0.63 

0.91 

-0.29 

23331 

C 

0 

2 

4 

-0.27 

0.74 

0.50 

-0.23 

23331 

D 

0 

1 

2 

0.74 

0.00 

1.06 

-0.06 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23332 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23332 

A 

1 

28 

62 

1.90 

0.21 

0.96 

0.38 

23332 

B 

0 

6 

13 

0.72 

0.53 

0.83 

-0.27 

23332 

C 

0 

9 

20 

1.20 

0.38 

1.63 

-0.14 

23332 

D 

0 

2 

4 

0.58 

0.81 

0.62 

-0.17 

23333 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23333 

A 

1 

35 

78 

1.64 

0.24 

0.89 

0.51 

23333 

B 

0 

3 

7 

-0.34 

0.93 

0.83 

-0.28 

23333 

C 

0 

4 

9 

-0.11 

0.48 

0.64 

-0.28 

23333 

D 

0 

3 

7 

-0.27 

0.36 

0.45 

-0.26 

23334 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23334 

A 

1 

37 

82 

1.64 

0.23 

0.91 

0.34 

23334 

B 

0 

5 

11 

-0.14 

0.60 

0.65 

-0.36 

23334 

C 

0 

2 

4 

0.27 

1.50 

1.39 

-0.16 

23334 

D 

0 

1 

2 

2.45 

0.00 

5.21 

0.10 

23335 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23335 

A 

1 

37 

82 

2.19 

0.24 

0.70 

0.58 

23335 

B 

0 

3 

7 

-0.43 

0.91 

0.43 

-0.34 

23335 

C 

0 

1 

2 

0.68 

0.00 

0.76 

-0.09 

23335 

D 

0 

4 

9 

-0.60 

0.69 

0.34 

-0.43 

23336 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.00 

23336 

A 

1 

38 

88 

1.80 

0.23 

0.83 

0.48 

23336 

B 

0 

1 

2 

0.87 

0.00 

1.16 

-0.07 

23336 

C 

0 

2 

5 

-0.46 

0.10 

0.31 

-0.28 

23336 

D 

0 

2 

5 

-1.26 

0.73 

0.18 

-0.40 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23337 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23337 

A 

1 

42 

93 

1.50 

0.22 

0.97 

0.23 

23337 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23337 

C 

0 

3 

7 

0.20 

0.83 

1.02 

-0.23 

23337 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23338 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

23338 

A 

1 

30 

67 

1.53 

0.22 

1.02 

0.46 

23338 

B 

0 

5 

11 

0.65 

0.68 

1.84 

-0.08 

23338 

C 

0 

6 

13 

0.63 

0.28 

0.97 

-0.09 

23338 

D 

0 

4 

9 

-1.91 

1.21 

0.32 

-0.57 

23339 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23339 

A 

1 

31 

69 

1.88 

0.27 

0.80 

0.54 

23339 

B 

0 

10 

22 

0.24 

0.29 

0.70 

-0.37 

23339 

C 

0 

2 

4 

-0.33 

1.23 

0.56 

-0.23 

23339 

D 

0 

2 

4 

-0.48 

0.53 

0.30 

-0.25 

23340 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23340 

A 

1 

38 

84 

1.62 

0.24 

0.89 

0.38 

23340 

B 

0 

2 

4 

1.94 

0.17 

3.47 

0.08 

23340 

C 

0 

3 

7 

-0.82 

0.29 

0.23 

-0.38 

23340 

D 

0 

2 

4 

-0.68 

0.97 

0.38 

-0.29 

23341 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23341 

A 

1 

36 

80 

1.61 

0.22 

0.75 

0.55 

23341 

B 

0 

4 

9 

-0.09 

0.53 

0.78 

-0.26 

23341 

C 

0 

2 

4 

0.59 

0.18 

0.99 

-0.08 

23341 

D 

0 

3 

7 

-1.75 

0.19 

0.10 

-0.51 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23342 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23342 

A 

1 

35 

78 

1.78 

0.31 

4.39 

0.27 

23342 

B 

0 

6 

13 

1.19 

0.66 

2.93 

-0.08 

23342 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23342 

D 

0 

4 

9 

-0.15 

0.16 

0.39 

-0.30 

23343 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23343 

A 

1 

44 

96 

1.71 

0.23 

1.06 

0.23 

23343 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23343 

C 

0 

2 

4 

0.04 

0.07 

0.49 

-0.23 

23343 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23344 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23344 

A 

1 

38 

83 

1.77 

0.23 

1.32 

0.47 

23344 

B 

0 

2 

4 

0.83 

1.31 

2.15 

-0.08 

23344 

C 

0 

5 

11 

-0.50 

0.63 

0.60 

-0.43 

23344 

D 

0 

1 

2 

-0.58 

0.00 

0.27 

-0.19 

23345 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23345 

A 

1 

31 

70 

1.89 

0.24 

1.14 

0.50 

23345 

B 

0 

2 

5 

-0.53 

0.58 

0.24 

-0.29 

23345 

C 

0 

10 

23 

0.49 

0.36 

0.95 

-0.35 

23345 

D 

0 

1 

2 

0.17 

0.00 

0.41 

-0.13 

23346 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

23346 

A 

1 

39 

87 

1.86 

0.21 

0.90 

0.51 

23346 

B 

0 

1 

2 

0.00 

0.00 

0.38 

-0.17 

23346 

C 

0 

4 

9 

-0.16 

0.27 

0.37 

-0.39 

23346 

D 

0 

1 

2 

-0.67 

0.00 

0.20 

-0.24 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23347 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23347 

A 

1 

38 

84 

1.85 

0.23 

1.18 

0.26 

23347 

B 

0 

3 

7 

0.56 

0.31 

0.61 

-0.22 

23347 

C 

0 

2 

4 

1.89 

0.26 

2.19 

0.03 

23347 

D 

0 

2 

4 

0.39 

0.46 

0.52 

-0.21 

23348 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23348 

A 

1 

36 

80 

1.94 

0.25 

0.92 

0.52 

23348 

B 

0 

6 

13 

-0.15 

0.62 

0.60 

-0.40 

23348 

C 

0 

3 

7 

-0.30 

0.38 

0.35 

-0.29 

23348 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23349 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23349 

A 

1 

40 

89 

1.40 

0.20 

0.89 

0.44 

23349 

B 

0 

2 

4 

-0.49 

0.34 

0.37 

-0.26 

23349 

C 

0 

1 

2 

-2.07 

0.00 

0.07 

-0.36 

23349 

D 

0 

2 

4 

0.22 

0.73 

0.92 

-0.15 

23350 

* 

-1 

3795 

95 

1.50 

0.02 

0.00 

-0.04 

23350 

A 

1 

142 

72 

2.17 

0.11 

1.06 

0.46 

23350 

B 

0 

20 

10 

0.74 

0.20 

0.75 

-0.25 

23350 

C 

0 

34 

17 

0.75 

0.15 

0.79 

-0.34 

23350 

D 

0 

1 

1 

0.53 

0.00 

0.44 

-0.06 

23351 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23351 

A 

1 

40 

89 

1.80 

0.25 

0.94 

0.27 

23351 

B 

0 

1 

2 

1.16 

0.00 

1.43 

-0.05 

23351 

C 

0 

2 

4 

0.45 

1.22 

1.30 

-0.16 

23351 

D 

0 

2 

4 

0.05 

2.21 

2.17 

-0.21 

easyCBM  CCSS  Second  Grade  Math  Measure  Development 


452 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23352 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

23352 

A 

1 

30 

67 

1.42 

0.20 

0.90 

0.47 

23352 

B 

0 

9 

20 

0.33 

0.31 

0.79 

-0.29 

23352 

C 

0 

2 

4 

1.10 

0.54 

1.49 

0.01 

23352 

D 

0 

4 

9 

-0.45 

0.68 

0.49 

-0.38 

23353 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.01 

23353 

A 

1 

34 

74 

1.94 

0.27 

0.76 

0.52 

23353 

B 

0 

4 

9 

-0.03 

0.38 

0.58 

-0.26 

23353 

C 

0 

5 

11 

-0.03 

0.93 

2.05 

-0.29 

23353 

D 

0 

3 

7 

-0.40 

0.45 

0.38 

-0.28 

23354 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23354 

A 

1 

33 

73 

1.75 

0.23 

1.01 

0.41 

23354 

B 

0 

9 

20 

0.72 

0.40 

1.32 

-0.24 

23354 

C 

0 

1 

2 

0.83 

0.00 

0.84 

-0.06 

23354 

D 

0 

2 

4 

-0.92 

1.15 

0.25 

-0.36 

23355 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

0.00 

23355 

A 

1 

43 

96 

1.58 

0.22 

1.12 

-0.01 

23355 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23355 

C 

0 

2 

4 

1.65 

0.31 

2.41 

0.01 

23355 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23356 

* 

-1 

3805 

95 

1.51 

0.02 

0.00 

-0.03 

23356 

A 

1 

158 

84 

1.98 

0.10 

0.84 

0.47 

23356 

B 

0 

5 

3 

-0.01 

0.30 

0.39 

-0.21 

23356 

C 

0 

21 

11 

0.38 

0.25 

1.00 

-0.35 

23356 

D 

0 

3 

2 

-0.63 

0.15 

0.17 

-0.22 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23357 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

23357 

A 

1 

33 

72 

1.93 

0.28 

0.77 

0.58 

23357 

B 

0 

4 

9 

0.44 

0.92 

1.80 

-0.13 

23357 

C 

0 

7 

15 

-0.46 

0.39 

0.49 

-0.38 

23357 

D 

0 

2 

4 

-2.44 

0.37 

0.05 

-0.42 

23358 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23358 

A 

1 

35 

78 

1.88 

0.27 

0.93 

0.43 

23358 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23358 

C 

0 

9 

20 

0.18 

0.35 

0.83 

-0.42 

23358 

D 

0 

1 

2 

0.60 

0.00 

0.74 

-0.09 

23359 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23359 

A 

1 

32 

71 

1.96 

0.26 

0.88 

0.50 

23359 

B 

0 

2 

4 

1.30 

0.11 

1.31 

-0.03 

23359 

C 

0 

8 

18 

0.27 

0.31 

0.66 

-0.38 

23359 

D 

0 

3 

7 

-0.14 

0.14 

0.32 

-0.29 

23360 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23360 

A 

1 

35 

80 

1.56 

0.25 

1.02 

0.31 

23360 

B 

0 

5 

11 

0.75 

0.75 

2.80 

-0.14 

23360 

C 

0 

2 

5 

0.68 

0.16 

0.96 

-0.09 

23360 

D 

0 

2 

5 

-0.77 

0.80 

0.30 

-0.30 

23361 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

-0.01 

23361 

A 

1 

38 

86 

1.86 

0.25 

0.86 

0.43 

23361 

B 

0 

1 

2 

-0.42 

0.00 

0.29 

-0.20 

23361 

C 

0 

4 

9 

0.13 

0.49 

0.67 

-0.30 

23361 

D 

0 

1 

2 

-0.62 

0.00 

0.24 

-0.22 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23362 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23362 

A 

1 

38 

84 

1.84 

0.26 

1.18 

0.46 

23362 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23362 

C 

0 

5 

11 

-0.14 

0.41 

0.60 

-0.34 

23362 

D 

0 

2 

4 

-0.74 

0.29 

0.26 

-0.29 

23363 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.03 

23363 

A 

1 

37 

82 

2.29 

0.25 

0.81 

0.51 

23363 

B 

0 

4 

9 

0.52 

0.47 

0.87 

-0.26 

23363 

C 

0 

3 

7 

-0.67 

0.42 

0.21 

-0.41 

23363 

D 

0 

1 

2 

0.47 

0.00 

0.56 

-0.13 

23364 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.00 

23364 

A 

1 

28 

65 

2.11 

0.31 

1.03 

0.52 

23364 

B 

0 

6 

14 

0.64 

0.26 

0.80 

-0.20 

23364 

C 

0 

7 

16 

0.39 

0.37 

0.74 

-0.29 

23364 

D 

0 

2 

5 

-1.00 

0.07 

0.13 

-0.33 

23365 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.04 

23365 

A 

1 

31 

70 

1.29 

0.22 

1.00 

0.35 

23365 

B 

0 

9 

20 

0.78 

0.45 

2.47 

-0.07 

23365 

C 

0 

2 

5 

-2.05 

0.06 

0.07 

-0.47 

23365 

D 

0 

2 

5 

-0.07 

0.59 

0.58 

-0.16 

23366 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.04 

23366 

A 

1 

42 

93 

1.08 

0.21 

0.86 

0.35 

23366 

B 

0 

2 

4 

-1.91 

0.34 

0.14 

-0.43 

23366 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23366 

D 

0 

1 

2 

0.99 

0.00 

2.32 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23367 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

23367 

A 

1 

30 

65 

1.62 

0.22 

1.28 

0.42 

23367 

B 

0 

8 

17 

0.97 

0.48 

1.92 

-0.08 

23367 

C 

0 

3 

7 

0.41 

0.29 

0.59 

-0.16 

23367 

D 

0 

5 

11 

-0.39 

0.62 

0.57 

-0.42 

23368 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23368 

A 

1 

35 

78 

2.00 

0.23 

0.94 

0.41 

23368 

B 

0 

4 

9 

1.15 

0.60 

1.58 

-0.11 

23368 

C 

0 

5 

11 

0.41 

0.60 

0.85 

-0.30 

23368 

D 

0 

1 

2 

-1.53 

0.00 

0.07 

-0.32 

23369 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23369 

A 

1 

36 

80 

1.98 

0.22 

0.87 

0.40 

23369 

B 

0 

2 

4 

1.27 

0.36 

1.25 

-0.06 

23369 

C 

0 

3 

7 

1.74 

1.18 

4.62 

0.01 

23369 

D 

0 

4 

9 

-0.95 

0.61 

0.19 

-0.54 

23370 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

23370 

A 

1 

31 

70 

1.62 

0.27 

0.88 

0.51 

23370 

B 

0 

6 

14 

-0.13 

0.52 

0.80 

-0.30 

23370 

C 

0 

5 

11 

0.05 

0.66 

1.02 

-0.23 

23370 

D 

0 

2 

5 

-0.88 

0.31 

0.23 

-0.27 

23371 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

23371 

A 

1 

35 

80 

1.57 

0.23 

0.78 

0.53 

23371 

B 

0 

6 

14 

0.12 

0.61 

1.20 

-0.24 

23371 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23371 

D 

0 

3 

7 

-2.03 

0.48 

0.10 

-0.52 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23372 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.03 

23372 

A 

1 

40 

91 

1.42 

0.21 

0.65 

0.53 

23372 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23372 

C 

0 

2 

5 

0.25 

0.17 

0.95 

-0.12 

23372 

D 

0 

2 

5 

-3.33 

0.68 

0.03 

-0.61 

23373 

* 

-1 

1491 

37 

1.64 

0.03 

0.00 

0.07 

23373 

A 

1 

1902 

76 

1.84 

0.03 

1.11 

0.47 

23373 

B 

0 

214 

9 

0.31 

0.08 

1.13 

-0.23 

23373 

C 

0 

249 

10 

0.19 

0.07 

0.91 

-0.27 

23373 

D 

0 

136 

5 

-0.14 

0.11 

0.62 

-0.25 

23374 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23374 

A 

1 

34 

77 

1.67 

0.26 

0.87 

0.51 

23374 

B 

0 

1 

2 

0.20 

0.00 

0.68 

-0.09 

23374 

C 

0 

1 

2 

-0.30 

0.00 

0.41 

-0.14 

23374 

D 

0 

8 

18 

-0.49 

0.58 

0.80 

-0.47 

23375 

* 

-1 

3948 

99 

1.51 

0.02 

0.00 

0.00 

23375 

A 

1 

31 

70 

2.09 

0.24 

0.87 

0.54 

23375 

B 

0 

2 

5 

0.31 

0.55 

0.50 

-0.19 

23375 

C 

0 

8 

18 

0.79 

0.40 

1.20 

-0.25 

23375 

D 

0 

3 

7 

-0.80 

0.13 

0.14 

-0.44 

23376 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

23376 

A 

1 

31 

69 

2.32 

0.27 

1.03 

0.49 

23376 

B 

0 

7 

16 

0.90 

0.35 

0.94 

-0.26 

23376 

C 

0 

6 

13 

0.72 

0.38 

0.76 

-0.29 

23376 

D 

0 

1 

2 

-0.34 

0.00 

0.19 

-0.22 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23377 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

0.00 

23377 

A 

1 

35 

81 

1.95 

0.23 

0.92 

0.54 

23377 

B 

0 

1 

2 

-0.58 

0.00 

0.21 

-0.23 

23377 

C 

0 

5 

12 

0.24 

0.21 

0.52 

-0.33 

23377 

D 

0 

2 

5 

-0.73 

0.02 

0.19 

-0.34 

23378 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.02 

23378 

A 

1 

42 

91 

1.41 

0.18 

0.76 

0.50 

23378 

B 

0 

2 

4 

-0.44 

0.69 

0.46 

-0.26 

23378 

C 

0 

2 

4 

-1.42 

0.59 

0.16 

-0.42 

23378 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23379 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.02 

23379 

A 

1 

36 

82 

1.42 

0.24 

1.46 

0.28 

23379 

B 

0 

5 

11 

0.16 

0.35 

0.76 

-0.27 

23379 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23379 

D 

0 

3 

7 

0.76 

0.63 

1.50 

-0.09 

23380 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23380 

A 

1 

36 

80 

1.74 

0.24 

1.18 

0.48 

23380 

B 

0 

2 

4 

-0.11 

0.74 

0.53 

-0.21 

23380 

C 

0 

4 

9 

-0.39 

0.50 

0.43 

-0.37 

23380 

D 

0 

3 

7 

0.37 

0.22 

0.70 

-0.18 

23381 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23381 

A 

1 

33 

73 

1.91 

0.24 

0.73 

0.58 

23381 

B 

0 

6 

13 

-0.39 

0.39 

0.41 

-0.43 

23381 

C 

0 

3 

7 

0.36 

0.81 

0.96 

-0.16 

23381 

D 

0 

3 

7 

-0.39 

0.91 

0.57 

-0.29 
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ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23382 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23382 

A 

1 

36 

80 

1.67 

0.19 

1.01 

0.32 

23382 

B 

0 

3 

7 

0.47 

0.30 

0.58 

-0.22 

23382 

C 

0 

3 

7 

1.06 

0.81 

1.54 

-0.09 

23382 

D 

0 

3 

7 

0.51 

1.43 

2.93 

-0.21 

23383 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23383 

A 

1 

35 

78 

2.08 

0.25 

0.76 

0.57 

23383 

B 

0 

5 

11 

-0.08 

0.30 

0.44 

-0.37 

23383 

C 

0 

3 

7 

0.23 

0.45 

0.59 

-0.23 

23383 

D 

0 

2 

4 

-0.61 

0.89 

0.30 

-0.30 

23384 

* 

-1 

3950 

99 

1.52 

0.02 

0.00 

0.03 

23384 

A 

1 

38 

90 

1.33 

0.20 

0.73 

0.48 

23384 

B 

0 

2 

5 

0.82 

1.78 

5.28 

-0.03 

23384 

C 

0 

1 

2 

-1.65 

0.00 

0.15 

-0.26 

23384 

D 

0 

1 

2 

-5.44 

0.00 

0.00 

-0.62 

23385 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.00 

23385 

A 

1 

35 

80 

1.75 

0.26 

1.00 

0.33 

23385 

B 

0 

4 

9 

0.99 

1.40 

7.45 

-0.09 

23385 

C 

0 

4 

9 

0.03 

0.35 

0.55 

-0.27 

23385 

D 

0 

1 

2 

-0.58 

0.00 

0.26 

-0.19 

23386 

* 

-1 

3790 

95 

1.52 

0.02 

0.00 

0.01 

23386 

A 

1 

137 

68 

1.79 

0.11 

1.12 

0.37 

23386 

B 

0 

39 

19 

0.85 

0.17 

1.21 

-0.23 

23386 

C 

0 

23 

11 

0.66 

0.18 

0.89 

-0.22 

23386 

D 

0 

3 

1 

0.29 

0.17 

0.43 

-0.11 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23387 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23387 

A 

1 

32 

71 

1.77 

0.22 

0.93 

0.45 

23387 

B 

0 

7 

16 

0.95 

0.38 

1.45 

-0.11 

23387 

C 

0 

6 

13 

-0.44 

0.74 

1.13 

-0.48 

23387 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

23388 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

23388 

A 

1 

32 

73 

1.89 

0.28 

0.96 

0.52 

23388 

B 

0 

3 

7 

0.06 

0.70 

0.88 

-0.20 

23388 

C 

0 

4 

9 

-0.48 

0.24 

0.33 

-0.33 

23388 

D 

0 

5 

11 

0.01 

0.78 

1.53 

-0.27 

23389 

* 

-1 

3782 

95 

1.52 

0.02 

0.00 

0.00 

23389 

A 

1 

152 

72 

1.93 

0.09 

0.88 

0.53 

23389 

B 

0 

9 

4 

0.22 

0.25 

0.49 

-0.22 

23389 

C 

0 

47 

22 

0.52 

0.14 

0.79 

-0.42 

23389 

D 

0 

2 

1 

-0.69 

1.96 

0.54 

-0.17 

23390 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.01 

23390 

A 

1 

41 

91 

1.59 

0.22 

0.96 

0.35 

23390 

B 

0 

2 

4 

-0.41 

0.87 

0.43 

-0.28 

23390 

C 

0 

1 

2 

0.08 

0.00 

0.50 

-0.14 

23390 

D 

0 

1 

2 

0.16 

0.00 

0.54 

-0.14 

23391 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.03 

23391 

A 

1 

32 

71 

1.66 

0.23 

1.10 

0.49 

23391 

B 

0 

7 

16 

0.97 

0.44 

1.74 

-0.04 

23391 

C 

0 

1 

2 

-2.01 

0.00 

0.06 

-0.28 

23391 

D 

0 

5 

11 

-1.48 

0.95 

0.42 

-0.54 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23392 

* 

-1 

3946 

99 

1.52 

0.02 

0.00 

0.03 

23392 

A 

1 

28 

61 

1.71 

0.21 

0.72 

0.55 

23392 

B 

0 

5 

11 

0.26 

0.47 

0.75 

-0.21 

23392 

C 

0 

7 

15 

0.58 

0.51 

2.14 

-0.16 

23392 

D 

0 

6 

13 

-0.47 

0.56 

0.47 

-0.44 

23393 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.04 

23393 

A 

1 

36 

82 

1.15 

0.26 

1.13 

0.25 

23393 

B 

0 

2 

5 

0.71 

2.22 

7.32 

-0.03 

23393 

C 

0 

3 

7 

0.30 

1.00 

1.97 

-0.11 

23393 

D 

0 

3 

7 

-0.56 

1.02 

0.86 

-0.25 

23394 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

23394 

A 

1 

32 

71 

1.97 

0.28 

0.85 

0.49 

23394 

B 

0 

3 

7 

-0.37 

0.39 

0.32 

-0.31 

23394 

C 

0 

7 

16 

0.26 

0.22 

0.63 

-0.33 

23394 

D 

0 

3 

7 

0.92 

0.69 

1.68 

-0.10 

23395 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

23395 

A 

1 

36 

80 

1.97 

0.24 

0.79 

0.46 

23395 

B 

0 

4 

9 

0.28 

0.70 

1.07 

-0.27 

23395 

C 

0 

3 

7 

0.60 

0.98 

1.43 

-0.17 

23395 

D 

0 

2 

4 

-0.71 

0.27 

0.19 

-0.32 

23396 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

23396 

A 

1 

35 

81 

1.92 

0.25 

0.70 

0.59 

23396 

B 

0 

2 

5 

-0.17 

0.22 

0.44 

-0.21 

23396 

C 

0 

2 

5 

0.21 

1.05 

1.01 

-0.16 

23396 

D 

0 

4 

9 

-1.42 

0.46 

0.17 

-0.53 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

23397 

* 

-1 

3786 

95 

1.52 

0.02 

0.00 

0.02 

23397 

A 

1 

168 

82 

1.56 

0.09 

1.02 

0.34 

23397 

B 

0 

24 

12 

0.70 

0.20 

1.27 

-0.20 

23397 

C 

0 

13 

6 

0.24 

0.26 

0.66 

-0.24 

23397 

D 

0 

1 

0 

-0.62 

0.00 

0.20 

-0.12 

23398 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

23398 

A 

1 

31 

69 

1.66 

0.21 

0.98 

0.42 

23398 

B 

0 

6 

13 

0.95 

0.60 

2.01 

-0.10 

23398 

C 

0 

4 

9 

0.61 

0.36 

0.77 

-0.16 

23398 

D 

0 

4 

9 

-0.51 

0.80 

0.43 

-0.42 

23399 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

0.00 

23399 

A 

1 

35 

76 

1.92 

0.24 

1.06 

0.44 

23399 

B 

0 

4 

9 

0.18 

0.28 

0.47 

-0.30 

23399 

C 

0 

3 

7 

1.52 

0.64 

2.26 

-0.01 

23399 

D 

0 

4 

9 

-0.15 

0.25 

0.33 

-0.37 

23400 

* 

-1 

3946 

99 

1.51 

0.02 

0.00 

-0.01 

23400 

A 

1 

30 

65 

2.04 

0.33 

1.34 

0.29 

23400 

B 

0 

5 

11 

0.64 

0.60 

0.86 

-0.20 

23400 

C 

0 

5 

11 

1.69 

0.93 

5.14 

0.01 

23400 

D 

0 

6 

13 

0.58 

0.50 

0.89 

-0.24 

2G1 1 

* 

-1 

3891 

97 

1.51 

0.02 

0.00 

-0.04 

2G1 1 

A 

1 

88 

87 

1.92 

0.12 

1.24 

0.01 

2G1 1 

B 

0 

3 

3 

1.31 

0.52 

1.04 

-0.09 

2G1 1 

C 

0 

10 

10 

2.06 

0.38 

3.67 

0.04 

2G1 1 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G110 

* 

-1 

3880 

97 

1.53 

0.02 

0.00 

0.04 

2G110 

A 

1 

94 

84 

1.31 

0.09 

0.96 

0.34 

2G110 

B 

0 

5 

4 

0.18 

0.56 

0.99 

-0.22 

2G110 

C 

0 

13 

12 

0.50 

0.28 

0.99 

-0.25 

2G110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G111 

* 

-1 

3903 

98 

1.51 

0.02 

0.00 

-0.01 

2G111 

A 

1 

88 

99 

1.59 

0.13 

0.98 

0.15 

2G111 

B 

0 

1 

1 

-0.15 

0.00 

0.30 

-0.15 

2G111 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G112 

* 

-1 

3920 

98 

1.51 

0.02 

0.00 

-0.05 

2G112 

A 

1 

30 

42 

2.56 

0.23 

1.32 

0.35 

2G112 

B 

0 

6 

8 

1.49 

0.52 

0.91 

-0.15 

2G112 

C 

0 

36 

50 

1.78 

0.17 

1.09 

-0.26 

2G112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G113 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

2G113 

A 

1 

44 

65 

2.34 

0.19 

1.20 

0.28 

2G113 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G113 

C 

0 

24 

35 

1.50 

0.32 

2.48 

-0.28 

2G113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G114 

* 

-1 

3922 

98 

1.51 

0.02 

0.00 

-0.03 

2G114 

A 

1 

61 

87 

1.97 

0.19 

1.14 

0.19 

2G114 

B 

0 

9 

13 

1.16 

0.41 

1.84 

-0.19 

2G114 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G115 

* 

-1 

3924 

98 

1.50 

0.02 

0.00 

-0.06 

2G115 

A 

1 

53 

78 

2.53 

0.18 

1.00 

0.43 

2G115 

B 

0 

15 

22 

1.13 

0.26 

0.84 

-0.43 

2G115 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G116 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.01 

2G116 

A 

1 

45 

61 

1.78 

0.14 

0.93 

0.41 

2G116 

B 

0 

24 

32 

0.87 

0.22 

1.33 

-0.32 

2G116 

C 

0 

5 

7 

0.56 

0.74 

1.82 

-0.20 

2G116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G117 

* 

-1 

3900 

98 

1.51 

0.02 

0.00 

-0.03 

2G117 

A 

1 

48 

52 

2.08 

0.19 

1.59 

0.23 

2G117 

B 

0 

36 

39 

1.59 

0.16 

1.36 

-0.15 

2G117 

C 

0 

8 

9 

1.27 

0.35 

0.96 

-0.14 

2G117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G118 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2G118 

A 

1 

16 

19 

2.04 

0.28 

1.22 

0.26 

2G118 

B 

0 

25 

30 

1.54 

0.20 

1.60 

0.03 

2G118 

C 

0 

42 

51 

1.25 

0.15 

0.92 

-0.24 

2G118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G119 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

2G119 

A 

1 

73 

94 

1.47 

0.14 

1.06 

0.19 

2G119 

B 

0 

2 

3 

0.69 

0.32 

0.86 

-0.10 

2G119 

C 

0 

3 

4 

0.50 

0.22 

0.70 

-0.15 

2G119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G12 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2G12 

A 

1 

58 

73 

2.64 

0.15 

0.96 

0.43 

2G12 

B 

0 

11 

14 

1.08 

0.24 

0.54 

-0.37 

2G12 

C 

0 

11 

14 

1.67 

0.47 

2.00 

-0.19 

2G12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G120 

* 

-1 

3825 

96 

1.50 

0.02 

0.00 

-0.04 

2G120 

A 

1 

157 

94 

1.83 

0.09 

1.02 

0.18 

2G120 

B 

0 

7 

4 

1.01 

0.30 

1.02 

-0.15 

2G120 

C 

0 

3 

2 

0.97 

0.91 

1.65 

-0.10 

2G120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G121 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.02 

2G121 

A 

1 

44 

59 

1.93 

0.23 

1.11 

0.47 

2G121 

B 

0 

16 

22 

0.95 

0.22 

1.24 

-0.13 

2G121 

C 

0 

14 

19 

-0.15 

0.29 

0.45 

-0.46 

2G121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G122 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2G122 

A 

1 

80 

95 

1.57 

0.13 

1.09 

-0.04 

2G122 

B 

0 

3 

4 

1.96 

0.46 

3.06 

0.06 

2G122 

C 

0 

1 

1 

1.33 

0.00 

1.29 

-0.02 

2G122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G123 

* 

-1 

3922 

98 

1.51 

0.02 

0.00 

0.00 

2G123 

A 

1 

50 

71 

1.70 

0.15 

1.10 

0.20 

2G123 

B 

0 

12 

17 

1.37 

0.31 

1.85 

-0.08 

2G123 

C 

0 

8 

11 

1.02 

0.35 

1.14 

-0.19 

2G123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G124 

* 

-1 

3891 

97 

1.51 

0.02 

0.00 

-0.04 

2G124 

A 

1 

95 

94 

1.96 

0.11 

1.04 

0.15 

2G124 

B 

0 

6 

6 

1.23 

0.56 

2.05 

-0.15 

2G124 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G125 

* 

-1 

3857 

97 

1.50 

0.02 

0.00 

-0.06 

2G125 

A 

1 

109 

81 

2.28 

0.13 

0.89 

0.42 

2G125 

B 

0 

12 

9 

1.10 

0.35 

1.30 

-0.19 

2G125 

C 

0 

14 

10 

0.43 

0.35 

0.86 

-0.37 

2G125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G126 

* 

-1 

3881 

97 

1.52 

0.02 

0.00 

0.04 

2G126 

A 

1 

104 

94 

1.28 

0.09 

0.93 

0.36 

2G126 

B 

0 

4 

4 

0.10 

0.48 

0.72 

-0.22 

2G126 

C 

0 

3 

3 

-0.39 

0.15 

0.30 

-0.28 

2G126 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G127 

* 

-1 

3904 

98 

1.51 

0.02 

0.00 

-0.01 

2G127 

A 

1 

85 

97 

1.65 

0.12 

1.01 

0.15 

2G127 

B 

0 

2 

2 

0.16 

0.06 

0.40 

-0.19 

2G127 

C 

0 

1 

1 

1.83 

0.00 

2.11 

0.02 

2G127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G128 

* 

-1 

3920 

98 

1.51 

0.02 

0.00 

-0.05 

2G128 

A 

1 

68 

94 

2.13 

0.14 

1.05 

0.17 

2G128 

B 

0 

1 

1 

0.79 

0.00 

0.49 

-0.13 

2G128 

C 

0 

3 

4 

1.38 

0.58 

1.21 

-0.12 

2G128 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G129 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

2G129 

A 

1 

67 

99 

2.08 

0.17 

1.00 

0.18 

2G129 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G129 

C 

0 

1 

1 

-0.06 

0.00 

0.30 

-0.18 

2G129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G13 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.03 

2G13 

A 

1 

65 

94 

1.97 

0.18 

1.01 

0.23 

2G13 

B 

0 

3 

4 

0.92 

0.45 

0.99 

-0.14 

2G13 

C 

0 

1 

1 

-0.60 

0.00 

0.18 

-0.21 

2G13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G130 

* 

-1 

3924 

98 

1.50 

0.02 

0.00 

-0.06 

2G130 

A 

1 

61 

90 

2.38 

0.17 

1.02 

0.36 

2G130 

B 

0 

5 

7 

0.45 

0.21 

0.36 

-0.37 

2G130 

C 

0 

2 

3 

1.64 

0.27 

1.13 

-0.07 

2G130 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G131 

* 

-1 

3818 

96 

1.51 

0.02 

0.00 

-0.02 

2G131 

A 

1 

164 

94 

1.68 

0.09 

1.06 

0.10 

2G131 

B 

0 

1 

1 

1.01 

0.00 

0.86 

-0.04 

2G131 

C 

0 

9 

5 

1.20 

0.27 

1.35 

-0.09 

2G131 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G132 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.01 

2G132 

A 

1 

66 

89 

1.51 

0.14 

1.03 

0.27 

2G132 

B 

0 

2 

3 

0.02 

0.27 

0.41 

-0.20 

2G132 

C 

0 

6 

8 

0.68 

0.34 

0.99 

-0.19 

2G132 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G133 

* 

-1 

3900 

98 

1.51 

0.02 

0.00 

-0.03 

2G133 

A 

1 

66 

72 

2.09 

0.15 

1.13 

0.36 

2G133 

B 

0 

25 

27 

1.15 

0.18 

0.96 

-0.34 

2G133 

C 

0 

1 

1 

0.46 

0.00 

0.35 

-0.12 

2G133 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G134 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2G134 

A 

1 

72 

87 

1.52 

0.13 

1.15 

0.09 

2G134 

B 

0 

2 

2 

0.88 

0.85 

1.06 

-0.09 

2G134 

C 

0 

9 

11 

1.33 

0.26 

1.60 

-0.05 

2G134 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G135 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

2G135 

A 

1 

43 

55 

1.81 

0.19 

1.15 

0.38 

2G135 

B 

0 

24 

31 

1.22 

0.19 

1.36 

-0.11 

2G135 

C 

0 

11 

14 

0.26 

0.19 

0.41 

-0.39 

2G135 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G136 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2G136 

A 

1 

52 

65 

2.68 

0.18 

1.27 

0.41 

2G136 

B 

0 

14 

18 

1.27 

0.26 

0.64 

-0.36 

2G136 

C 

0 

14 

18 

1.84 

0.26 

1.21 

-0.16 

2G136 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G137 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.02 

2G137 

A 

1 

46 

62 

1.79 

0.23 

1.18 

0.38 

2G137 

B 

0 

16 

22 

0.60 

0.35 

1.32 

-0.25 

2G137 

C 

0 

12 

16 

0.50 

0.33 

1.47 

-0.23 

2G137 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G138 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2G138 

A 

1 

71 

85 

1.67 

0.14 

1.09 

0.18 

2G138 

B 

0 

12 

14 

1.21 

0.32 

2.03 

-0.13 

2G138 

C 

0 

1 

1 

-0.23 

0.00 

0.24 

-0.17 

2G138 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G139 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2G139 

A 

1 

25 

36 

1.80 

0.22 

1.52 

0.16 

2G139 

B 

0 

35 

51 

1.38 

0.16 

1.18 

-0.18 

2G139 

C 

0 

9 

13 

1.64 

0.43 

2.01 

0.03 

2G139 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G14 

* 

-1 

3892 

97 

1.50 

0.02 

0.00 

-0.04 

2G14 

A 

1 

94 

94 

2.02 

0.11 

0.97 

0.34 

2G14 

B 

0 

4 

4 

0.28 

0.38 

0.41 

-0.30 

2G14 

C 

0 

2 

2 

0.72 

0.30 

0.54 

-0.15 

2G14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G140 

* 

-1 

3883 

97 

1.52 

0.02 

0.00 

0.04 

2G140 

A 

1 

42 

39 

1.67 

0.15 

1.07 

0.39 

2G140 

B 

0 

49 

45 

0.98 

0.11 

1.03 

-0.21 

2G140 

C 

0 

18 

17 

0.73 

0.22 

0.86 

-0.22 

2G140 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G141 

* 

-1 

3904 

98 

1.51 

0.02 

0.00 

-0.01 

2G141 

A 

1 

31 

35 

2.22 

0.22 

1.16 

0.39 

2G141 

B 

0 

14 

16 

1.37 

0.30 

1.29 

-0.09 

2G141 

C 

0 

43 

49 

1.25 

0.14 

0.99 

-0.31 

2G141 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G142 

* 

-1 

3920 

98 

1.51 

0.02 

0.00 

-0.05 

2G142 

A 

1 

69 

96 

2.14 

0.14 

1.00 

0.26 

2G142 

B 

0 

3 

4 

0.61 

0.17 

0.43 

-0.26 

2G142 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G142 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G15 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

2G15 

A 

1 

32 

47 

2.82 

0.23 

1.23 

0.51 

2G15 

B 

0 

27 

40 

1.35 

0.20 

0.86 

-0.40 

2G15 

C 

0 

9 

13 

1.38 

0.50 

0.96 

-0.18 

2G15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G16 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.03 

2G16 

A 

1 

26 

38 

2.28 

0.35 

2.34 

0.21 

2G16 

B 

0 

7 

10 

1.32 

0.44 

0.96 

-0.13 

2G16 

C 

0 

36 

52 

1.72 

0.20 

1.44 

-0.12 

2G16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G17 

* 

-1 

3924 

98 

1.50 

0.02 

0.00 

-0.06 

2G17 

A 

1 

47 

69 

2.52 

0.20 

1.26 

0.33 

2G17 

B 

0 

9 

13 

1.30 

0.40 

0.97 

-0.27 

2G17 

C 

0 

12 

18 

1.74 

0.30 

1.35 

-0.17 

2G17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G18 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.01 

2G18 

A 

1 

65 

88 

1.46 

0.15 

1.15 

0.13 

2G18 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G18 

C 

0 

9 

12 

0.99 

0.21 

1.26 

-0.13 

2G18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G19 

* 

-1 

3900 

98 

1.51 

0.02 

0.00 

-0.03 

2G19 

A 

1 

53 

58 

2.17 

0.17 

1.24 

0.34 

2G19 

B 

0 

10 

11 

1.30 

0.33 

1.01 

-0.15 

2G19 

C 

0 

29 

32 

1.34 

0.17 

1.07 

-0.27 

2G19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G21 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2G21 

A 

1 

79 

95 

1.53 

0.11 

0.98 

0.19 

2G21 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G21 

C 

0 

4 

5 

0.62 

0.64 

1.12 

-0.19 

2G21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G210 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

2G210 

A 

1 

53 

68 

1.55 

0.17 

1.30 

0.18 

2G210 

B 

0 

14 

18 

0.56 

0.22 

0.76 

-0.34 

2G210 

C 

0 

11 

14 

1.81 

0.31 

3.02 

0.14 

2G210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G211 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2G211 

A 

1 

79 

99 

2.31 

0.15 

1.02 

0.14 

2G211 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G211 

C 

0 

1 

1 

0.72 

0.00 

0.47 

-0.14 

2G211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G212 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.02 

2G212 

A 

1 

70 

95 

1.45 

0.17 

0.99 

0.34 

2G212 

B 

0 

3 

4 

-0.92 

1.27 

0.75 

-0.30 

2G212 

C 

0 

1 

1 

-0.71 

0.00 

0.26 

-0.15 

2G212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G213 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2G213 

A 

1 

79 

94 

1.65 

0.13 

1.01 

0.25 

2G213 

B 

0 

4 

5 

0.53 

0.33 

0.67 

-0.20 

2G213 

C 

0 

1 

1 

0.03 

0.00 

0.35 

-0.15 

2G213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G214 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2G214 

A 

1 

51 

74 

1.73 

0.15 

1.09 

0.26 

2G214 

B 

0 

17 

25 

1.12 

0.22 

1.33 

-0.24 

2G214 

C 

0 

1 

1 

0.96 

0.00 

0.70 

-0.07 

2G214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G215 

* 

-1 

3805 

95 

1.51 

0.02 

0.00 

-0.01 

2G215 

A 

1 

159 

85 

1.78 

0.08 

0.96 

0.38 

2G215 

B 

0 

14 

7 

0.78 

0.21 

0.79 

-0.22 

2G215 

C 

0 

14 

7 

0.53 

0.24 

0.71 

-0.29 

2G215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G216 

* 

-1 

3892 

97 

1.50 

0.02 

0.00 

-0.04 

2G216 

A 

1 

96 

96 

2.00 

0.11 

0.93 

0.33 

2G216 

B 

0 

3 

3 

-0.30 

0.12 

0.19 

-0.35 

2G216 

C 

0 

1 

1 

1.35 

0.00 

1.00 

-0.05 

2G216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G217 

* 

-1 

3883 

97 

1.52 

0.02 

0.00 

0.04 

2G217 

A 

1 

99 

91 

1.27 

0.09 

1.02 

0.21 

2G217 

B 

0 

2 

2 

1.46 

0.25 

1.90 

0.04 

2G217 

C 

0 

8 

7 

0.34 

0.30 

0.89 

-0.26 

2G217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G218 

* 

-1 

3834 

96 

1.50 

0.02 

0.00 

-0.05 

2G218 

A 

1 

132 

84 

2.02 

0.11 

1.04 

0.29 

2G218 

B 

0 

8 

5 

0.51 

0.44 

0.86 

-0.24 

2G218 

C 

0 

18 

11 

1.22 

0.26 

1.54 

-0.17 

2G218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G219 

* 

-1 

3904 

98 

1.51 

0.02 

0.00 

-0.01 

2G219 

A 

1 

79 

90 

1.67 

0.13 

1.03 

0.16 

2G219 

B 

0 

6 

7 

0.93 

0.45 

1.43 

-0.16 

2G219 

C 

0 

3 

3 

1.39 

1.00 

2.95 

-0.04 

2G219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G22 

* 

-1 

3920 

98 

1.51 

0.02 

0.00 

-0.05 

2G22 

A 

1 

71 

99 

2.11 

0.14 

0.95 

0.24 

2G22 

B 

0 

1 

1 

-0.32 

0.00 

0.17 

-0.24 

2G22 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G220 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

2G220 

A 

1 

64 

94 

2.19 

0.17 

0.82 

0.42 

2G220 

B 

0 

2 

3 

-0.48 

0.69 

0.22 

-0.31 

2G220 

C 

0 

2 

3 

-0.18 

0.77 

0.31 

-0.27 

2G220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G221 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.03 

2G221 

A 

1 

65 

94 

1.93 

0.18 

1.04 

0.12 

2G221 

B 

0 

1 

1 

-0.60 

0.00 

0.18 

-0.21 

2G221 

C 

0 

3 

4 

1.79 

0.82 

3.72 

-0.01 

2G221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G222 

* 

-1 

3924 

98 

1.50 

0.02 

0.00 

-0.06 

2G222 

A 

1 

65 

96 

2.28 

0.16 

0.99 

0.19 

2G222 

B 

0 

1 

1 

3.02 

0.00 

4.74 

0.07 

2G222 

C 

0 

2 

3 

0.04 

0.19 

0.25 

-0.28 

2G222 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G223 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.01 

2G223 

A 

1 

73 

99 

1.42 

0.14 

1.01 

0.07 

2G223 

B 

0 

1 

1 

0.74 

0.00 

0.90 

-0.07 

2G223 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G223 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G224 

* 

-1 

3900 

98 

1.51 

0.02 

0.00 

-0.03 

2G224 

A 

1 

83 

90 

1.94 

0.13 

0.96 

0.32 

2G224 

B 

0 

4 

4 

0.95 

0.42 

0.86 

-0.15 

2G224 

C 

0 

5 

5 

0.39 

0.46 

0.60 

-0.29 

2G224 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G225 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2G225 

A 

1 

61 

73 

1.52 

0.14 

1.25 

0.05 

2G225 

B 

0 

15 

18 

1.53 

0.19 

1.75 

0.02 

2G225 

C 

0 

7 

8 

1.14 

0.49 

1.40 

-0.10 

2G225 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G226 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

2G226 

A 

1 

62 

79 

1.66 

0.14 

0.91 

0.41 

2G226 

B 

0 

10 

13 

0.46 

0.38 

1.24 

-0.31 

2G226 

C 

0 

6 

8 

0.42 

0.24 

0.61 

-0.24 

2G226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G227 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2G227 

A 

1 

75 

94 

2.34 

0.15 

0.98 

0.15 

2G227 

B 

0 

4 

5 

2.15 

0.65 

2.58 

-0.02 

2G227 

C 

0 

1 

1 

-1.05 

0.00 

0.07 

-0.29 

2G227 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G228 

* 

-1 

3919 

98 

1.52 

0.02 

0.00 

0.01 

2G228 

A 

1 

70 

96 

1.45 

0.17 

0.98 

0.22 

2G228 

B 

0 

2 

3 

0.04 

0.75 

0.71 

-0.16 

2G228 

C 

0 

1 

1 

-0.44 

0.00 

0.34 

-0.15 

2G228 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G229 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2G229 

A 

1 

83 

99 

1.58 

0.13 

1.02 

-0.01 

2G229 

B 

0 

1 

1 

1.68 

0.00 

1.92 

0.01 

2G229 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G23 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2G23 

A 

1 

66 

96 

1.60 

0.13 

1.00 

0.16 

2G23 

B 

0 

3 

4 

0.76 

0.47 

0.84 

-0.16 

2G23 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G230 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2G230 

A 

1 

75 

77 

2.15 

0.13 

1.15 

0.36 

2G230 

B 

0 

6 

6 

0.88 

0.42 

0.69 

-0.24 

2G230 

C 

0 

17 

17 

1.31 

0.21 

1.01 

-0.25 

2G230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G231 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.02 

2G231 

A 

1 

75 

90 

1.33 

0.10 

1.08 

0.13 

2G231 

B 

0 

2 

2 

0.52 

0.53 

0.70 

-0.14 

2G231 

C 

0 

6 

7 

1.09 

0.34 

1.55 

-0.07 

2G231 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G232 

* 

-1 

3906 

98 

1.51 

0.02 

0.00 

-0.01 

2G232 

A 

1 

82 

95 

1.67 

0.12 

0.96 

0.25 

2G232 

B 

0 

1 

1 

-0.29 

0.00 

0.24 

-0.18 

2G232 

C 

0 

3 

3 

0.52 

0.58 

0.78 

-0.18 

2G232 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G233 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2G233 

A 

1 

68 

99 

2.02 

0.14 

1.01 

0.11 

2G233 

B 

0 

1 

1 

0.94 

0.00 

0.61 

-0.11 

2G233 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G233 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G234 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

2G234 

A 

1 

61 

90 

2.14 

0.18 

0.97 

0.20 

2G234 

B 

0 

3 

4 

2.85 

0.36 

5.14 

0.12 

2G234 

C 

0 

4 

6 

-0.03 

0.60 

0.40 

-0.36 

2G234 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G235 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2G235 

A 

1 

13 

19 

2.75 

0.55 

2.41 

0.28 

2G235 

B 

0 

53 

79 

1.70 

0.18 

1.18 

-0.28 

2G235 

C 

0 

1 

1 

2.03 

0.00 

0.80 

0.01 

2G235 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G236 

* 

-1 

3925 

98 

1.50 

0.02 

0.00 

-0.07 

2G236 

A 

1 

64 

96 

2.30 

0.17 

1.00 

0.20 

2G236 

B 

0 

3 

4 

1.03 

0.75 

0.99 

-0.20 

2G236 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G236 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G237 

* 

-1 

3919 

98 

1.52 

0.02 

0.00 

0.01 

2G237 

A 

-1 

73 

100 

1.42 

0.13 

0.00 

0.00 

2G237 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G237 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G237 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G238 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2G238 

A 

1 

87 

96 

1.88 

0.12 

0.91 

0.33 

2G238 

B 

0 

1 

1 

-0.55 

0.00 

0.17 

-0.21 

2G238 

C 

0 

3 

3 

0.10 

0.54 

0.44 

-0.26 

2G238 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G239 

* 

-1 

3857 

97 

1.50 

0.02 

0.00 

-0.07 

2G239 

A 

1 

125 

93 

2.23 

0.12 

0.90 

0.40 

2G239 

B 

0 

1 

1 

-0.33 

0.00 

0.19 

-0.15 

2G239 

C 

0 

9 

7 

0.11 

0.20 

0.36 

-0.37 

2G239 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G24 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2G24 

A 

1 

80 

96 

1.52 

0.11 

0.98 

0.18 

2G24 

B 

0 

1 

1 

2.19 

0.00 

3.10 

0.07 

2G24 

C 

0 

2 

2 

-0.30 

0.33 

0.27 

-0.27 

2G24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G240 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

2G240 

A 

1 

70 

90 

1.47 

0.14 

1.04 

0.16 

2G240 

B 

0 

6 

8 

1.40 

0.25 

1.87 

0.00 

2G240 

C 

0 

2 

3 

-0.77 

0.27 

0.19 

-0.30 

2G240 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G241 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2G241 

A 

1 

70 

88 

2.50 

0.14 

0.91 

0.43 

2G241 

B 

0 

5 

6 

1.15 

0.70 

1.21 

-0.23 

2G241 

C 

0 

5 

6 

0.48 

0.19 

0.31 

-0.36 

2G241 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G25 

* 

-1 

3920 

98 

1.52 

0.02 

0.00 

0.01 

2G25 

A 

1 

69 

96 

1.41 

0.17 

1.00 

0.18 

2G25 

B 

0 

2 

3 

0.58 

0.21 

0.96 

-0.09 

2G25 

C 

0 

1 

1 

-0.71 

0.00 

0.26 

-0.17 

2G25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G26 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2G26 

A 

1 

79 

94 

1.63 

0.13 

1.00 

0.17 

2G26 

B 

0 

2 

2 

1.41 

0.09 

1.39 

-0.02 

2G26 

C 

0 

3 

4 

0.41 

0.81 

0.93 

-0.19 

2G26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G27 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2G27 

A 

1 

67 

97 

1.60 

0.13 

1.00 

0.16 

2G27 

B 

0 

1 

1 

0.96 

0.00 

0.85 

-0.07 

2G27 

C 

0 

1 

1 

0.18 

0.00 

0.38 

-0.16 

2G27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G28 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2G28 

A 

1 

38 

39 

2.65 

0.15 

0.90 

0.51 

2G28 

B 

0 

49 

50 

1.45 

0.14 

0.81 

-0.42 

2G28 

C 

0 

11 

11 

1.53 

0.34 

0.93 

-0.13 

2G28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G29 

* 

-1 

3910 

98 

1.52 

0.02 

0.00 

0.02 

2G29 

A 

1 

80 

98 

1.33 

0.09 

0.97 

0.26 

2G29 

B 

0 

2 

2 

-0.09 

0.59 

0.42 

-0.26 

2G29 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G31 

* 

-1 

3906 

98 

1.51 

0.02 

0.00 

-0.01 

2G31 

A 

1 

79 

92 

1.70 

0.13 

1.01 

0.26 

2G31 

B 

0 

6 

7 

0.80 

0.17 

0.75 

-0.20 

2G31 

C 

0 

1 

1 

-0.29 

0.00 

0.23 

-0.18 

2G31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G310 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2G310 

A 

-1 

69 

100 

2.00 

0.14 

0.00 

0.00 

2G310 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G310 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G310 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G311 

* 

-1 

3836 

96 

1.50 

0.02 

0.00 

-0.04 

2G311 

A 

1 

90 

58 

2.03 

0.13 

1.36 

0.22 

2G311 

B 

0 

36 

23 

1.45 

0.18 

1.45 

-0.17 

2G311 

C 

0 

30 

19 

1.56 

0.18 

1.44 

-0.10 

2G311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G312 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

2G312 

A 

1 

64 

94 

2.20 

0.16 

0.80 

0.44 

2G312 

B 

0 

3 

4 

-0.29 

0.48 

0.26 

-0.35 

2G312 

C 

0 

1 

1 

-0.96 

0.00 

0.11 

-0.26 

2G312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G313 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2G313 

A 

1 

61 

91 

2.07 

0.18 

1.00 

0.34 

2G313 

B 

0 

6 

9 

0.31 

0.33 

0.60 

-0.34 

2G313 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G314 

* 

-1 

3925 

98 

1.50 

0.02 

0.00 

-0.07 

2G314 

A 

1 

49 

73 

2.50 

0.19 

1.31 

0.32 

2G314 

B 

0 

16 

24 

1.58 

0.28 

1.53 

-0.28 

2G314 

C 

0 

2 

3 

1.18 

0.95 

0.77 

-0.14 

2G314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G315 

* 

-1 

3919 

98 

1.52 

0.02 

0.00 

0.01 

2G315 

A 

1 

70 

96 

1.47 

0.14 

1.00 

0.21 

2G315 

B 

0 

1 

1 

0.05 

0.00 

0.44 

-0.14 

2G315 

C 

0 

2 

3 

0.32 

0.58 

0.67 

-0.16 

2G315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G316 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2G316 

A 

1 

36 

40 

2.15 

0.23 

1.59 

0.24 

2G316 

B 

0 

47 

52 

1.54 

0.15 

1.20 

-0.22 

2G316 

C 

0 

8 

9 

1.73 

0.37 

1.22 

-0.02 

2G316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Second  Grade  Math  Measure  Development 


480 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G317 

* 

-1 

3836 

96 

1.52 

0.02 

0.00 

0.01 

2G317 

A 

1 

60 

38 

1.94 

0.19 

1.68 

0.28 

2G317 

B 

0 

40 

26 

1.13 

0.18 

1.34 

-0.16 

2G317 

C 

0 

56 

36 

1.23 

0.14 

1.46 

-0.14 

2G317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G318 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2G318 

A 

1 

77 

93 

1.59 

0.11 

0.93 

0.34 

2G318 

B 

0 

4 

5 

0.34 

0.48 

0.63 

-0.25 

2G318 

C 

0 

2 

2 

-0.03 

0.33 

0.34 

-0.23 

2G318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G319 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

2G319 

A 

1 

51 

65 

1.78 

0.16 

0.99 

0.43 

2G319 

B 

0 

4 

5 

0.06 

0.50 

0.46 

-0.26 

2G319 

C 

0 

23 

29 

0.83 

0.18 

0.97 

-0.32 

2G319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G32 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2G32 

A 

1 

76 

95 

2.42 

0.14 

0.83 

0.42 

2G32 

B 

0 

1 

1 

-1.05 

0.00 

0.07 

-0.29 

2G32 

C 

0 

3 

4 

0.23 

0.32 

0.29 

-0.31 

2G32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G320 

* 

-1 

3920 

98 

1.52 

0.02 

0.00 

0.01 

2G320 

A 

1 

47 

65 

1.67 

0.23 

1.30 

0.29 

2G320 

B 

0 

18 

25 

0.98 

0.20 

1.42 

-0.15 

2G320 

C 

0 

7 

10 

0.26 

0.36 

0.73 

-0.25 

2G320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G321 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2G321 

A 

1 

39 

46 

1.91 

0.19 

1.25 

0.27 

2G321 

B 

0 

30 

36 

1.21 

0.20 

1.24 

-0.24 

2G321 

C 

0 

15 

18 

1.45 

0.27 

1.42 

-0.05 

2G321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G322 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2G322 

A 

1 

17 

25 

2.34 

0.28 

1.24 

0.42 

2G322 

B 

0 

49 

71 

1.34 

0.13 

0.95 

-0.33 

2G322 

C 

0 

3 

4 

0.83 

0.16 

0.38 

-0.15 

2G322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G323 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2G323 

A 

1 

91 

93 

2.00 

0.11 

1.02 

0.25 

2G323 

B 

0 

5 

5 

0.89 

0.61 

1.40 

-0.21 

2G323 

C 

0 

2 

2 

0.94 

0.08 

0.63 

-0.13 

2G323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G324 

* 

-1 

3911 

98 

1.52 

0.02 

0.00 

0.02 

2G324 

A 

1 

45 

56 

1.50 

0.14 

1.23 

0.27 

2G324 

B 

0 

33 

41 

1.06 

0.12 

1.04 

-0.22 

2G324 

C 

0 

3 

4 

0.61 

0.38 

0.59 

-0.16 

2G324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G325 

* 

-1 

3906 

98 

1.51 

0.02 

0.00 

-0.01 

2G325 

A 

1 

80 

93 

1.67 

0.13 

1.01 

0.20 

2G325 

B 

0 

3 

3 

0.71 

0.32 

0.71 

-0.15 

2G325 

C 

0 

3 

3 

0.90 

0.74 

1.31 

-0.12 

2G325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G326 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2G326 

A 

1 

50 

72 

2.26 

0.16 

1.12 

0.36 

2G326 

B 

0 

5 

7 

0.78 

0.30 

0.44 

-0.30 

2G326 

C 

0 

14 

20 

1.53 

0.24 

1.18 

-0.21 

2G326 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G327 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

2G327 

A 

1 

62 

91 

2.20 

0.17 

0.85 

0.34 

2G327 

B 

0 

1 

1 

-0.19 

0.00 

0.22 

-0.19 

2G327 

C 

0 

5 

7 

0.62 

0.81 

1.46 

-0.28 

2G327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G328 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2G328 

A 

1 

65 

97 

1.94 

0.18 

1.03 

0.13 

2G328 

B 

0 

1 

1 

1.61 

0.00 

1.73 

-0.03 

2G328 

C 

0 

1 

1 

0.06 

0.00 

0.37 

-0.16 

2G328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G329 

* 

-1 

3925 

98 

1.50 

0.02 

0.00 

-0.07 

2G329 

A 

1 

51 

76 

2.39 

0.19 

1.23 

0.20 

2G329 

B 

0 

4 

6 

1.48 

1.03 

2.25 

-0.14 

2G329 

C 

0 

12 

18 

1.85 

0.31 

1.57 

-0.14 

2G329 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G33 

* 

-1 

3920 

98 

1.52 

0.02 

0.00 

0.01 

2G33 

A 

1 

24 

33 

1.95 

0.25 

1.42 

0.32 

2G33 

B 

0 

14 

19 

1.51 

0.24 

1.32 

0.03 

2G33 

C 

0 

34 

47 

1.04 

0.18 

0.98 

-0.33 

2G33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G330 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2G330 

A 

1 

77 

85 

2.00 

0.13 

0.95 

0.41 

2G330 

B 

0 

7 

8 

1.07 

0.21 

0.83 

-0.18 

2G330 

C 

0 

7 

8 

0.23 

0.29 

0.42 

-0.38 

2G330 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G331 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2G331 

A 

1 

75 

90 

1.57 

0.12 

1.01 

0.24 

2G331 

B 

0 

6 

7 

1.13 

0.18 

1.10 

-0.10 

2G331 

C 

0 

2 

2 

-0.43 

0.46 

0.24 

-0.29 

2G331 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G332 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

2G332 

A 

1 

67 

86 

1.61 

0.13 

0.86 

0.42 

2G332 

B 

0 

6 

8 

0.55 

0.44 

1.07 

-0.21 

2G332 

C 

0 

5 

6 

-0.28 

0.35 

0.38 

-0.37 

2G332 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G333 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2G333 

A 

1 

62 

78 

2.52 

0.16 

1.09 

0.33 

2G333 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G333 

C 

0 

18 

23 

1.49 

0.28 

1.21 

-0.33 

2G333 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G334 

* 

-1 

3920 

98 

1.52 

0.02 

0.00 

0.01 

2G334 

A 

1 

61 

85 

1.56 

0.18 

0.96 

0.32 

2G334 

B 

0 

5 

7 

0.46 

0.48 

1.12 

-0.17 

2G334 

C 

0 

6 

8 

0.11 

0.42 

0.93 

-0.26 

2G334 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G335 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2G335 

A 

1 

75 

89 

1.73 

0.13 

0.90 

0.38 

2G335 

B 

0 

8 

10 

0.25 

0.34 

0.66 

-0.37 

2G335 

C 

0 

1 

1 

0.86 

0.00 

0.76 

-0.07 

2G335 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G336 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2G336 

A 

1 

63 

91 

1.69 

0.13 

0.93 

0.37 

2G336 

B 

0 

2 

3 

0.63 

0.33 

0.61 

-0.15 

2G336 

C 

0 

4 

6 

0.14 

0.06 

0.36 

-0.34 

2G336 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G337 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2G337 

A 

1 

67 

68 

2.13 

0.14 

1.32 

0.26 

2G337 

B 

0 

15 

15 

1.40 

0.30 

1.16 

-0.20 

2G337 

C 

0 

16 

16 

1.58 

0.19 

1.10 

-0.14 

2G337 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G338 

* 

-1 

3911 

98 

1.52 

0.02 

0.00 

0.02 

2G338 

A 

1 

57 

70 

1.49 

0.11 

0.98 

0.37 

2G338 

B 

0 

4 

5 

0.30 

0.48 

0.60 

-0.26 

2G338 

C 

0 

20 

25 

0.91 

0.16 

0.93 

-0.25 

2G338 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G339 

* 

-1 

3906 

98 

1.51 

0.02 

0.00 

-0.01 

2G339 

A 

1 

34 

40 

1.72 

0.22 

1.73 

0.08 

2G339 

B 

0 

8 

9 

0.91 

0.40 

0.83 

-0.20 

2G339 

C 

0 

44 

51 

1.66 

0.14 

1.52 

0.04 

2G339 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G34 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2G34 

A 

1 

29 

42 

2.07 

0.20 

1.75 

0.05 

2G34 

B 

0 

38 

55 

1.94 

0.20 

1.83 

-0.06 

2G34 

C 

0 

2 

3 

2.14 

0.00 

1.06 

0.02 

2G34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G340 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

2G340 

A 

1 

46 

68 

2.41 

0.20 

1.19 

0.37 

2G340 

B 

0 

8 

12 

0.93 

0.55 

1.06 

-0.29 

2G340 

C 

0 

14 

21 

1.47 

0.27 

1.31 

-0.20 

2G340 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G341 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2G341 

A 

1 

55 

82 

2.03 

0.20 

1.19 

0.17 

2G341 

B 

0 

1 

1 

-0.60 

0.00 

0.15 

-0.21 

2G341 

C 

0 

11 

16 

1.56 

0.43 

2.90 

-0.11 

2G341 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G342 

* 

-1 

3925 

98 

1.50 

0.02 

0.00 

-0.07 

2G342 

A 

1 

64 

96 

2.33 

0.16 

0.96 

0.32 

2G342 

B 

0 

2 

3 

0.50 

0.27 

0.39 

-0.23 

2G342 

C 

0 

1 

1 

-0.16 

0.00 

0.19 

-0.22 

2G342 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G35 

* 

-1 

3828 

96 

1.51 

0.02 

0.00 

-0.02 

2G35 

A 

1 

140 

85 

1.76 

0.10 

1.02 

0.27 

2G35 

B 

0 

20 

12 

0.90 

0.24 

1.26 

-0.23 

2G35 

C 

0 

4 

2 

0.55 

0.67 

0.99 

-0.14 

2G35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2G36 

* 

-1 

3920 

98 

1.52 

0.02 

0.00 

0.01 

2G36 

A 

1 

67 

93 

1.50 

0.14 

1.01 

0.19 

2G36 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G36 

C 

0 

5 

7 

0.64 

0.54 

1.26 

-0.19 

2G36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G37 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2G37 

A 

1 

75 

82 

1.88 

0.14 

1.22 

0.15 

2G37 

B 

0 

11 

12 

1.29 

0.30 

1.37 

-0.16 

2G37 

C 

0 

5 

5 

1.69 

0.20 

1.45 

-0.02 

2G37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G38 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2G38 

A 

1 

60 

72 

1.57 

0.14 

1.15 

0.13 

2G38 

B 

0 

1 

1 

1.36 

0.00 

1.08 

-0.01 

2G38 

C 

0 

22 

27 

1.26 

0.22 

1.53 

-0.13 

2G38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2G39 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

2G39 

A 

1 

55 

71 

1.72 

0.16 

1.04 

0.40 

2G39 

B 

0 

12 

15 

0.96 

0.24 

1.18 

-0.16 

2G39 

C 

0 

11 

14 

0.37 

0.29 

0.76 

-0.36 

2G39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD101 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2MD101 

A 

1 

50 

63 

2.71 

0.18 

1.39 

0.41 

2MD101 

B 

0 

6 

8 

0.57 

0.44 

0.43 

-0.38 

2MD101 

C 

0 

24 

30 

1.85 

0.18 

1.10 

-0.22 

2MD101 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD1010 

* 

-1 

3920 

98 

1.52 

0.02 

0.00 

0.01 

2MD1010 

A 

1 

51 

71 

1.81 

0.20 

0.97 

0.49 

2MD1010 

B 

0 

13 

18 

0.14 

0.19 

0.57 

-0.40 

2MD1010 

C 

0 

8 

11 

0.45 

0.24 

0.79 

-0.22 

2MD1010 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD1011 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2MD1011 

A 

1 

62 

74 

1.87 

0.14 

1.00 

0.42 

2MD1011 

B 

0 

16 

19 

0.73 

0.21 

0.78 

-0.36 

2MD1011 

C 

0 

6 

7 

0.85 

0.37 

0.98 

-0.18 

2MD1011 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD1012 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2MD1012 

A 

1 

36 

52 

2.24 

0.15 

0.72 

0.67 

2MD1012 

B 

0 

32 

46 

0.86 

0.12 

0.65 

-0.63 

2MD1012 

C 

0 

1 

1 

0.05 

0.00 

0.23 

-0.18 

2MD1012 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD1013 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2MD1013 

A 

1 

50 

51 

2.22 

0.15 

1.41 

0.26 

2MD1013 

B 

0 

5 

5 

-0.12 

0.15 

0.13 

-0.42 

2MD1013 

C 

0 

43 

44 

1.83 

0.15 

1.44 

-0.08 

2MD1013 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD1014 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.02 

2MD1014 

A 

1 

59 

74 

1.48 

0.11 

1.03 

0.37 

2MD1014 

B 

0 

5 

6 

0.51 

0.47 

0.81 

-0.23 

2MD1014 

C 

0 

16 

20 

0.84 

0.15 

0.88 

-0.26 

2MD1014 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD1015 

* 

-1 

3906 

98 

1.51 

0.02 

0.00 

-0.01 

2MD1015 

A 

1 

64 

74 

1.87 

0.14 

1.00 

0.40 

2MD1015 

B 

0 

12 

14 

0.72 

0.15 

0.61 

-0.32 

2MD1015 

C 

0 

10 

12 

0.98 

0.36 

1.39 

-0.20 

2MD1015 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD102 

* 

-1 

3836 

96 

1.52 

0.02 

0.00 

0.01 

2MD102 

A 

1 

88 

56 

1.97 

0.14 

1.12 

0.43 

2MD102 

B 

0 

30 

19 

0.58 

0.14 

0.65 

-0.34 

2MD102 

C 

0 

38 

24 

1.04 

0.16 

1.19 

-0.19 

2MD102 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD103 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2MD103 

A 

1 

41 

59 

2.59 

0.15 

0.75 

0.63 

2MD103 

B 

0 

5 

7 

0.84 

0.27 

0.40 

-0.28 

2MD103 

C 

0 

23 

33 

1.20 

0.18 

0.74 

-0.50 

2MD103 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD104 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

2MD104 

A 

1 

47 

69 

2.62 

0.17 

0.79 

0.61 

2MD104 

B 

0 

12 

18 

0.91 

0.36 

1.05 

-0.37 

2MD104 

C 

0 

9 

13 

0.54 

0.25 

0.39 

-0.41 

2MD104 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD105 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2MD105 

A 

1 

51 

76 

2.41 

0.18 

0.76 

0.61 

2MD105 

B 

0 

13 

19 

0.35 

0.23 

0.48 

-0.52 

2MD105 

C 

0 

3 

4 

0.11 

0.25 

0.29 

-0.27 

2MD105 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD106 

* 

-1 

3925 

98 

1.50 

0.02 

0.00 

-0.07 

2MD106 

A 

1 

35 

52 

2.73 

0.23 

1.36 

0.38 

2MD106 

B 

0 

24 

36 

1.61 

0.24 

1.18 

-0.35 

2MD106 

C 

0 

8 

12 

2.02 

0.39 

1.37 

-0.06 

2MD106 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD107 

* 

-1 

3921 

98 

1.52 

0.02 

0.00 

0.01 

2MD107 

A 

1 

70 

99 

1.47 

0.14 

1.01 

0.09 

2MD107 

B 

0 

1 

1 

0.58 

0.00 

0.73 

-0.09 

2MD107 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD107 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD108 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2MD108 

A 

1 

76 

84 

1.96 

0.13 

1.01 

0.30 

2MD108 

B 

0 

11 

12 

0.63 

0.23 

0.60 

-0.36 

2MD108 

C 

0 

4 

4 

1.93 

0.77 

3.45 

0.03 

2MD108 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD109 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2MD109 

A 

1 

71 

86 

1.64 

0.12 

1.03 

0.35 

2MD109 

B 

0 

4 

5 

0.53 

0.29 

0.61 

-0.21 

2MD109 

C 

0 

8 

10 

0.66 

0.21 

0.69 

-0.26 

2MD109 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD21 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

2MD21 

A 

1 

45 

58 

1.87 

0.18 

1.14 

0.45 

2MD21 

B 

0 

10 

13 

1.21 

0.18 

1.10 

-0.06 

2MD21 

C 

0 

23 

29 

0.60 

0.16 

0.69 

-0.44 

2MD21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD210 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2MD210 

A 

1 

77 

96 

2.36 

0.14 

0.90 

0.28 

2MD210 

B 

0 

1 

1 

2.40 

0.00 

2.36 

0.01 

2MD210 

C 

0 

2 

3 

-0.53 

0.51 

0.14 

-0.35 

2MD210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD211 

* 

-1 

3825 

96 

1.50 

0.02 

0.00 

-0.04 

2MD211 

A 

1 

139 

83 

1.94 

0.09 

1.02 

0.32 

2MD211 

B 

0 

23 

14 

1.08 

0.19 

1.08 

-0.25 

2MD211 

C 

0 

5 

3 

0.62 

0.48 

0.73 

-0.18 

2MD211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD212 

* 

-1 

3920 

98 

1.52 

0.02 

0.00 

0.01 

2MD212 

A 

1 

65 

90 

1.48 

0.18 

1.00 

0.25 

2MD212 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD212 

C 

0 

7 

10 

0.28 

0.35 

0.97 

-0.25 

2MD212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD22 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2MD22 

A 

1 

71 

85 

1.78 

0.13 

0.92 

0.40 

2MD22 

B 

0 

9 

11 

0.82 

0.22 

0.83 

-0.23 

2MD22 

C 

0 

4 

5 

-0.21 

0.39 

0.31 

-0.35 

2MD22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD23 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2MD23 

A 

1 

45 

65 

1.79 

0.16 

1.11 

0.29 

2MD23 

B 

0 

12 

17 

0.86 

0.20 

0.74 

-0.31 

2MD23 

C 

0 

12 

17 

1.45 

0.32 

2.08 

-0.05 

2MD23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD24 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2MD24 

A 

1 

71 

72 

2.17 

0.12 

1.03 

0.36 

2MD24 

B 

0 

7 

7 

1.36 

0.60 

1.71 

-0.14 

2MD24 

C 

0 

20 

20 

1.24 

0.24 

1.16 

-0.31 

2MD24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD25 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.02 

2MD25 

A 

1 

64 

80 

1.48 

0.09 

0.86 

0.44 

2MD25 

B 

0 

6 

8 

0.18 

0.32 

0.51 

-0.36 

2MD25 

C 

0 

10 

13 

0.73 

0.33 

1.27 

-0.25 

2MD25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD26 

* 

-1 

3906 

98 

1.51 

0.02 

0.00 

-0.01 

2MD26 

A 

1 

49 

57 

2.01 

0.16 

1.04 

0.41 

2MD26 

B 

0 

28 

33 

1.12 

0.17 

1.09 

-0.31 

2MD26 

C 

0 

9 

10 

0.96 

0.33 

0.87 

-0.20 

2MD26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD27 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2MD27 

A 

1 

55 

80 

2.20 

0.15 

1.13 

0.34 

2MD27 

B 

0 

12 

17 

1.19 

0.23 

0.84 

-0.33 

2MD27 

C 

0 

2 

3 

1.54 

0.60 

1.05 

-0.07 

2MD27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD28 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

2MD28 

A 

1 

60 

88 

2.21 

0.18 

1.16 

0.32 

2MD28 

B 

0 

4 

6 

1.12 

0.68 

1.75 

-0.16 

2MD28 

C 

0 

4 

6 

0.49 

0.19 

0.43 

-0.27 

2MD28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD29 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2MD29 

A 

1 

50 

75 

2.34 

0.19 

0.99 

0.50 

2MD29 

B 

0 

5 

7 

0.06 

0.31 

0.32 

-0.36 

2MD29 

C 

0 

12 

18 

0.90 

0.28 

0.88 

-0.32 

2MD29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD31 

* 

-1 

3925 

98 

1.50 

0.02 

0.00 

-0.07 

2MD31 

A 

1 

47 

70 

2.69 

0.18 

0.95 

0.52 

2MD31 

B 

0 

11 

16 

1.45 

0.32 

1.00 

-0.26 

2MD31 

C 

0 

9 

13 

0.85 

0.28 

0.48 

-0.41 

2MD31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD310 

* 

-1 

3921 

98 

1.52 

0.02 

0.00 

0.01 

2MD310 

A 

1 

58 

82 

1.57 

0.15 

1.13 

0.21 

2MD310 

B 

0 

6 

8 

0.75 

0.41 

1.07 

-0.19 

2MD310 

C 

0 

7 

10 

1.15 

0.40 

1.54 

-0.09 

2MD310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD311 

* 

-1 

3822 

96 

1.52 

0.02 

0.00 

0.01 

2MD311 

A 

1 

164 

96 

1.49 

0.08 

0.98 

0.16 

2MD311 

B 

0 

2 

1 

-0.60 

0.46 

0.22 

-0.22 

2MD311 

C 

0 

4 

2 

1.19 

0.29 

1.29 

-0.04 

2MD311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD312 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2MD312 

A 

1 

79 

87 

1.95 

0.13 

0.96 

0.33 

2MD312 

B 

0 

6 

7 

1.18 

0.47 

1.36 

-0.14 

2MD312 

C 

0 

6 

7 

0.38 

0.36 

0.55 

-0.32 

2MD312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD313 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2MD313 

A 

1 

63 

76 

1.72 

0.13 

0.96 

0.40 

2MD313 

B 

0 

8 

10 

0.58 

0.23 

0.64 

-0.29 

2MD313 

C 

0 

12 

14 

0.87 

0.25 

0.90 

-0.24 

2MD313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD314 

* 

-1 

3914 

98 

1.52 

0.02 

0.00 

0.01 

2MD314 

A 

1 

53 

68 

1.69 

0.17 

1.13 

0.34 

2MD314 

B 

0 

10 

13 

0.89 

0.21 

0.90 

-0.17 

2MD314 

C 

0 

15 

19 

0.78 

0.25 

1.02 

-0.26 

2MD314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD315 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2MD315 

A 

1 

52 

65 

2.69 

0.18 

1.26 

0.42 

2MD315 

B 

0 

23 

29 

1.69 

0.23 

1.24 

-0.29 

2MD315 

C 

0 

5 

6 

0.91 

0.22 

0.36 

-0.27 

2MD315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD32 

* 

-1 

3920 

98 

1.52 

0.02 

0.00 

0.01 

2MD32 

A 

1 

30 

42 

1.93 

0.32 

1.60 

0.33 

2MD32 

B 

0 

6 

8 

0.15 

0.44 

0.54 

-0.25 

2MD32 

C 

0 

36 

50 

1.09 

0.17 

1.33 

-0.19 

2MD32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD33 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2MD33 

A 

1 

49 

58 

2.01 

0.16 

0.98 

0.44 

2MD33 

B 

0 

12 

14 

0.63 

0.31 

0.70 

-0.33 

2MD33 

C 

0 

23 

27 

1.16 

0.15 

0.95 

-0.22 

2MD33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD34 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2MD34 

A 

1 

49 

71 

1.69 

0.16 

1.20 

0.18 

2MD34 

B 

0 

4 

6 

1.17 

0.32 

0.97 

-0.09 

2MD34 

C 

0 

16 

23 

1.31 

0.23 

1.47 

-0.14 

2MD34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD35 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2MD35 

A 

1 

97 

99 

1.95 

0.11 

0.98 

0.20 

2MD35 

B 

0 

1 

1 

-0.26 

0.00 

0.21 

-0.20 

2MD35 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD36 

* 

-1 

3913 

98 

1.52 

0.02 

0.00 

0.02 

2MD36 

A 

1 

58 

73 

1.25 

0.12 

1.31 

-0.05 

2MD36 

B 

0 

1 

1 

-0.14 

0.00 

0.28 

-0.19 

2MD36 

C 

0 

20 

25 

1.42 

0.17 

1.79 

0.10 

2MD36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD37 

* 

-1 

3906 

98 

1.51 

0.02 

0.00 

-0.01 

2MD37 

A 

1 

60 

70 

1.86 

0.14 

1.04 

0.33 

2MD37 

B 

0 

11 

13 

0.77 

0.22 

0.72 

-0.29 

2MD37 

C 

0 

15 

17 

1.24 

0.30 

1.78 

-0.15 

2MD37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD38 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2MD38 

A 

1 

43 

62 

2.31 

0.17 

1.19 

0.35 

2MD38 

B 

0 

19 

28 

1.73 

0.24 

1.47 

-0.15 

2MD38 

C 

0 

7 

10 

0.86 

0.27 

0.44 

-0.34 

2MD38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD39 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

2MD39 

A 

1 

52 

76 

2.37 

0.20 

1.37 

0.41 

2MD39 

B 

0 

7 

10 

1.00 

0.33 

0.85 

-0.25 

2MD39 

C 

0 

9 

13 

0.97 

0.31 

0.92 

-0.29 

2MD39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD41 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2MD41 

A 

1 

40 

60 

2.51 

0.22 

1.05 

0.50 

2MD41 

B 

0 

14 

21 

0.99 

0.34 

0.99 

-0.33 

2MD41 

C 

0 

13 

19 

1.07 

0.28 

0.84 

-0.28 

2MD41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD410 

* 

-1 

3925 

98 

1.50 

0.02 

0.00 

-0.07 

2MD410 

A 

1 

46 

69 

2.77 

0.17 

0.76 

0.58 

2MD410 

B 

0 

10 

15 

1.58 

0.35 

1.15 

-0.21 

2MD410 

C 

0 

11 

16 

0.64 

0.24 

0.38 

-0.53 

2MD410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD411 

* 

-1 

3921 

98 

1.52 

0.02 

0.00 

0.01 

2MD411 

A 

1 

39 

55 

1.89 

0.16 

0.97 

0.41 

2MD411 

B 

0 

27 

38 

0.89 

0.21 

1.14 

-0.40 

2MD411 

C 

0 

5 

7 

1.25 

0.57 

1.51 

-0.05 

2MD411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD412 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2MD412 

A 

1 

59 

65 

2.21 

0.15 

0.92 

0.47 

2MD412 

B 

0 

21 

23 

0.97 

0.22 

0.91 

-0.38 

2MD412 

C 

0 

11 

12 

1.14 

0.27 

0.88 

-0.20 

2MD412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD413 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2MD413 

A 

1 

31 

37 

2.12 

0.20 

0.94 

0.47 

2MD413 

B 

0 

16 

19 

1.44 

0.25 

1.23 

-0.02 

2MD413 

C 

0 

36 

43 

0.97 

0.11 

0.67 

-0.44 

2MD413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD414 

* 

-1 

3915 

98 

1.52 

0.02 

0.00 

0.01 

2MD414 

A 

1 

37 

48 

2.05 

0.19 

0.90 

0.51 

2MD414 

B 

0 

25 

32 

0.98 

0.17 

0.94 

-0.28 

2MD414 

C 

0 

15 

19 

0.71 

0.21 

0.69 

-0.31 

2MD414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD415 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2MD415 

A 

1 

60 

75 

2.63 

0.15 

0.86 

0.46 

2MD415 

B 

0 

6 

8 

2.22 

0.64 

3.00 

-0.02 

2MD415 

C 

0 

14 

18 

0.84 

0.25 

0.49 

-0.51 

2MD415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD42 

* 

-1 

3920 

98 

1.52 

0.02 

0.00 

0.01 

2MD42 

A 

1 

42 

58 

2.10 

0.21 

0.72 

0.61 

2MD42 

B 

0 

23 

32 

0.37 

0.17 

0.69 

-0.47 

2MD42 

C 

0 

7 

10 

0.18 

0.36 

0.63 

-0.27 

2MD42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD43 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2MD43 

A 

1 

33 

39 

2.34 

0.22 

1.15 

0.53 

2MD43 

B 

0 

10 

12 

1.93 

0.15 

1.47 

0.11 

2MD43 

C 

0 

41 

49 

0.89 

0.11 

0.59 

-0.59 

2MD43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD44 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2MD44 

A 

1 

25 

36 

2.40 

0.19 

0.77 

0.60 

2MD44 

B 

0 

38 

55 

1.05 

0.13 

0.75 

-0.55 

2MD44 

C 

0 

6 

9 

1.37 

0.21 

0.82 

-0.06 

2MD44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD45 

* 

-1 

3854 

97 

1.50 

0.02 

0.00 

-0.07 

2MD45 

A 

1 

87 

63 

2.63 

0.12 

0.84 

0.59 

2MD45 

B 

0 

46 

33 

1.07 

0.14 

0.76 

-0.53 

2MD45 

C 

0 

5 

4 

0.78 

0.28 

0.40 

-0.19 

2MD45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD46 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2MD46 

A 

1 

72 

73 

2.25 

0.12 

0.96 

0.48 

2MD46 

B 

0 

24 

24 

0.95 

0.20 

0.83 

-0.50 

2MD46 

C 

0 

2 

2 

1.98 

0.44 

1.48 

0.01 

2MD46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD47 

* 

-1 

3913 

98 

1.52 

0.02 

0.00 

0.02 

2MD47 

A 

1 

35 

44 

1.71 

0.13 

0.89 

0.45 

2MD47 

B 

0 

27 

34 

1.03 

0.15 

0.99 

-0.21 

2MD47 

C 

0 

17 

22 

0.78 

0.19 

0.81 

-0.30 

2MD47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD48 

* 

-1 

3906 

98 

1.51 

0.02 

0.00 

-0.01 

2MD48 

A 

1 

62 

72 

2.01 

0.13 

0.80 

0.57 

2MD48 

B 

0 

18 

21 

0.73 

0.15 

0.66 

-0.40 

2MD48 

C 

0 

6 

7 

0.17 

0.28 

0.38 

-0.35 

2MD48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD49 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2MD49 

A 

1 

48 

70 

2.53 

0.13 

0.71 

0.70 

2MD49 

B 

0 

8 

12 

0.56 

0.25 

0.36 

-0.46 

2MD49 

C 

0 

13 

19 

0.94 

0.11 

0.46 

-0.45 

2MD49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD51 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.05 

2MD51 

A 

1 

51 

76 

2.56 

0.17 

0.80 

0.62 

2MD51 

B 

0 

9 

13 

0.78 

0.28 

0.55 

-0.36 

2MD51 

C 

0 

7 

10 

0.14 

0.22 

0.25 

-0.46 

2MD51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD510 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2MD510 

A 

1 

47 

70 

2.40 

0.20 

0.93 

0.51 

2MD510 

B 

0 

9 

13 

0.30 

0.36 

0.65 

-0.43 

2MD510 

C 

0 

11 

16 

1.13 

0.31 

1.04 

-0.24 

2MD510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD511 

* 

-1 

3925 

98 

1.50 

0.02 

0.00 

-0.07 

2MD511 

A 

1 

37 

55 

2.79 

0.19 

0.95 

0.45 

2MD511 

B 

0 

9 

13 

0.95 

0.41 

0.66 

-0.38 

2MD511 

C 

0 

21 

31 

1.84 

0.27 

1.69 

-0.20 

2MD511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD512 

* 

-1 

3857 

97 

1.50 

0.02 

0.00 

-0.06 

2MD512 

A 

1 

105 

78 

2.33 

0.13 

0.99 

0.45 

2MD512 

B 

0 

5 

4 

1.02 

0.66 

1.61 

-0.13 

2MD512 

C 

0 

25 

19 

0.71 

0.20 

0.75 

-0.42 

2MD512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD513 

* 

-1 

3921 

98 

1.52 

0.02 

0.00 

0.01 

2MD513 

A 

1 

48 

68 

1.94 

0.14 

0.81 

0.61 

2MD513 

B 

0 

13 

18 

0.45 

0.20 

0.57 

-0.42 

2MD513 

C 

0 

10 

14 

0.46 

0.25 

0.60 

-0.36 

2MD513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD514 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2MD514 

A 

1 

73 

80 

2.07 

0.13 

0.95 

0.47 

2MD514 

B 

0 

7 

8 

0.55 

0.27 

0.51 

-0.30 

2MD514 

C 

0 

11 

12 

0.74 

0.22 

0.64 

-0.33 

2MD514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD515 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2MD515 

A 

1 

25 

30 

1.97 

0.23 

1.32 

0.30 

2MD515 

B 

0 

37 

45 

1.25 

0.13 

0.90 

-0.20 

2MD515 

C 

0 

21 

25 

1.33 

0.25 

1.66 

-0.09 

2MD515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD52 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

2MD52 

A 

1 

45 

59 

1.92 

0.17 

0.95 

0.51 

2MD52 

B 

0 

24 

32 

0.70 

0.13 

0.68 

-0.43 

2MD52 

C 

0 

7 

9 

0.76 

0.45 

1.27 

-0.18 

2MD52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD53 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2MD53 

A 

1 

65 

81 

2.56 

0.15 

0.90 

0.44 

2MD53 

B 

0 

6 

8 

1.21 

0.56 

1.28 

-0.24 

2MD53 

C 

0 

9 

11 

1.03 

0.40 

0.82 

-0.34 

2MD53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD54 

* 

-1 

3921 

98 

1.52 

0.02 

0.00 

0.02 

2MD54 

A 

1 

33 

46 

2.39 

0.23 

0.64 

0.67 

2MD54 

B 

0 

19 

27 

0.39 

0.13 

0.51 

-0.40 

2MD54 

C 

0 

19 

27 

0.50 

0.23 

0.82 

-0.36 

2MD54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD55 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2MD55 

A 

1 

54 

64 

2.06 

0.14 

0.78 

0.56 

2MD55 

B 

0 

17 

20 

0.48 

0.20 

0.57 

-0.48 

2MD55 

C 

0 

13 

15 

1.01 

0.22 

0.91 

-0.21 

2MD55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD56 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2MD56 

A 

1 

43 

62 

1.97 

0.16 

0.95 

0.50 

2MD56 

B 

0 

9 

13 

1.02 

0.28 

0.92 

-0.20 

2MD56 

C 

0 

17 

25 

0.83 

0.14 

0.64 

-0.41 

2MD56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD57 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2MD57 

A 

1 

63 

64 

2.36 

0.11 

0.85 

0.52 

2MD57 

B 

0 

23 

23 

1.16 

0.23 

0.99 

-0.38 

2MD57 

C 

0 

12 

12 

1.10 

0.30 

0.79 

-0.27 

2MD57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD58 

* 

-1 

3913 

98 

1.52 

0.02 

0.00 

0.02 

2MD58 

A 

1 

65 

82 

1.41 

0.11 

1.03 

0.33 

2MD58 

B 

0 

3 

4 

0.77 

0.14 

0.77 

-0.12 

2MD58 

C 

0 

11 

14 

0.64 

0.23 

0.82 

-0.30 

2MD58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD59 

* 

-1 

3906 

98 

1.51 

0.02 

0.00 

-0.01 

2MD59 

A 

1 

62 

72 

1.97 

0.13 

0.85 

0.52 

2MD59 

B 

0 

17 

20 

0.65 

0.16 

0.62 

-0.43 

2MD59 

C 

0 

7 

8 

0.74 

0.38 

0.83 

-0.23 

2MD59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD61 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2MD61 

A 

1 

61 

88 

2.14 

0.13 

0.89 

0.33 

2MD61 

B 

0 

4 

6 

1.11 

0.67 

1.11 

-0.20 

2MD61 

C 

0 

4 

6 

0.86 

0.83 

1.58 

-0.25 

2MD61 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD610 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.05 

2MD610 

A 

1 

62 

93 

2.12 

0.18 

1.18 

0.12 

2MD610 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD610 

C 

0 

5 

7 

1.45 

0.57 

2.50 

-0.12 

2MD610 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD611 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2MD611 

A 

1 

56 

84 

2.14 

0.19 

1.08 

0.36 

2MD611 

B 

0 

5 

7 

1.03 

0.38 

1.02 

-0.17 

2MD611 

C 

0 

6 

9 

0.47 

0.44 

0.73 

-0.31 

2MD611 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD612 

* 

-1 

3925 

98 

1.50 

0.02 

0.00 

-0.07 

2MD612 

A 

1 

56 

84 

2.51 

0.17 

0.95 

0.45 

2MD612 

B 

0 

10 

15 

0.83 

0.29 

0.61 

-0.44 

2MD612 

C 

0 

1 

1 

1.37 

0.00 

0.73 

-0.08 

2MD612 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD613 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2MD613 

A 

1 

58 

83 

1.56 

0.14 

1.02 

0.25 

2MD613 

B 

0 

8 

11 

0.99 

0.46 

1.83 

-0.14 

2MD613 

C 

0 

4 

6 

0.49 

0.60 

1.02 

-0.21 

2MD613 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD62 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2MD62 

A 

1 

55 

60 

2.30 

0.14 

0.89 

0.52 

2MD62 

B 

0 

10 

11 

0.13 

0.22 

0.28 

-0.49 

2MD62 

C 

0 

26 

29 

1.38 

0.16 

1.41 

-0.22 

2MD62 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD63 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2MD63 

A 

1 

57 

69 

1.82 

0.13 

0.92 

0.48 

2MD63 

B 

0 

2 

2 

0.73 

0.29 

0.58 

-0.12 

2MD63 

C 

0 

24 

29 

0.76 

0.15 

0.73 

-0.45 

2MD63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD64 

* 

-1 

3839 

96 

1.51 

0.02 

0.00 

-0.01 

2MD64 

A 

1 

131 

86 

1.66 

0.10 

1.08 

0.19 

2MD64 

B 

0 

20 

13 

1.16 

0.17 

1.24 

-0.15 

2MD64 

C 

0 

2 

1 

0.23 

1.02 

0.59 

-0.14 

2MD64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD65 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

2MD65 

A 

1 

45 

59 

1.73 

0.19 

1.24 

0.32 

2MD65 

B 

0 

17 

22 

1.19 

0.19 

1.14 

-0.11 

2MD65 

C 

0 

14 

18 

0.74 

0.19 

0.73 

-0.28 

2MD65 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD66 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2MD66 

A 

1 

67 

84 

2.62 

0.14 

0.76 

0.57 

2MD66 

B 

0 

7 

9 

0.73 

0.33 

0.49 

-0.37 

2MD66 

C 

0 

6 

8 

0.45 

0.37 

0.36 

-0.40 

2MD66 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD67 

* 

-1 

3921 

98 

1.52 

0.02 

0.00 

0.02 

2MD67 

A 

1 

52 

73 

1.75 

0.20 

0.91 

0.46 

2MD67 

B 

0 

15 

21 

0.38 

0.23 

0.91 

-0.35 

2MD67 

C 

0 

4 

6 

-0.28 

0.21 

0.34 

-0.27 

2MD67 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD68 

* 

-1 

3850 

96 

1.51 

0.02 

0.00 

-0.04 

2MD68 

A 

1 

105 

74 

2.13 

0.12 

1.02 

0.43 

2MD68 

B 

0 

16 

11 

0.50 

0.23 

0.65 

-0.35 

2MD68 

C 

0 

21 

15 

1.12 

0.20 

1.09 

-0.21 

2MD68 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD69 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2MD69 

A 

1 

67 

80 

1.85 

0.13 

0.86 

0.46 

2MD69 

B 

0 

8 

10 

0.43 

0.21 

0.51 

-0.32 

2MD69 

C 

0 

9 

11 

0.59 

0.38 

0.94 

-0.30 

2MD69 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD71 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2MD71 

A 

1 

30 

43 

1.80 

0.19 

1.29 

0.20 

2MD71 

B 

0 

32 

46 

1.44 

0.18 

1.36 

-0.11 

2MD71 

C 

0 

7 

10 

1.12 

0.50 

1.76 

-0.14 

2MD71 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD710 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2MD710 

A 

1 

62 

63 

2.31 

0.13 

1.09 

0.45 

2MD710 

B 

0 

13 

13 

1.61 

0.25 

1.11 

-0.11 

2MD710 

C 

0 

23 

23 

1.07 

0.20 

0.72 

-0.42 

2MD710 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD711 

* 

-1 

3828 

96 

1.51 

0.02 

0.00 

-0.02 

2MD711 

A 

1 

51 

31 

1.88 

0.21 

2.34 

0.14 

2MD711 

B 

0 

18 

11 

0.78 

0.26 

0.76 

-0.25 

2MD711 

C 

0 

95 

58 

1.65 

0.10 

1.35 

0.03 

2MD711 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD712 

* 

-1 

3915 

98 

1.52 

0.02 

0.00 

0.02 

2MD712 

A 

1 

42 

55 

1.61 

0.12 

0.94 

0.39 

2MD712 

B 

0 

24 

31 

1.03 

0.13 

0.98 

-0.23 

2MD712 

C 

0 

11 

14 

0.80 

0.33 

1.11 

-0.25 

2MD712 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD72 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

2MD72 

A 

1 

53 

62 

1.85 

0.16 

1.20 

0.28 

2MD72 

B 

0 

18 

21 

1.13 

0.20 

1.06 

-0.22 

2MD72 

C 

0 

14 

16 

1.28 

0.29 

1.61 

-0.13 

2MD72 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD73 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2MD73 

A 

1 

47 

68 

2.30 

0.15 

0.98 

0.38 

2MD73 

B 

0 

16 

23 

1.60 

0.28 

1.89 

-0.20 

2MD73 

C 

0 

6 

9 

0.75 

0.47 

0.58 

-0.34 

2MD73 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD74 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.05 

2MD74 

A 

1 

19 

28 

2.93 

0.37 

2.63 

0.38 

2MD74 

B 

0 

37 

55 

2.01 

0.17 

1.06 

-0.04 

2MD74 

C 

0 

11 

16 

0.77 

0.37 

0.37 

-0.40 

2MD74 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD75 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2MD75 

A 

1 

24 

36 

2.41 

0.34 

2.04 

0.25 

2MD75 

B 

0 

35 

52 

1.77 

0.22 

1.63 

-0.10 

2MD75 

C 

0 

8 

12 

1.05 

0.36 

0.56 

-0.22 

2MD75 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD76 

* 

-1 

3925 

98 

1.50 

0.02 

0.00 

-0.07 

2MD76 

A 

1 

54 

81 

2.51 

0.17 

0.95 

0.41 

2MD76 

B 

0 

3 

4 

1.34 

0.85 

1.41 

-0.15 

2MD76 

C 

0 

10 

15 

1.07 

0.41 

1.03 

-0.37 

2MD76 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD77 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2MD77 

A 

1 

52 

74 

1.65 

0.15 

1.05 

0.34 

2MD77 

B 

0 

6 

9 

0.68 

0.49 

1.07 

-0.21 

2MD77 

C 

0 

12 

17 

0.84 

0.26 

1.05 

-0.24 

2MD77 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD78 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2MD78 

A 

1 

65 

71 

2.19 

0.13 

0.80 

0.52 

2MD78 

B 

0 

17 

19 

1.10 

0.22 

0.93 

-0.28 

2MD78 

C 

0 

9 

10 

0.29 

0.26 

0.39 

-0.42 

2MD78 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD79 

* 

-1 

3909 

98 

1.52 

0.02 

0.00 

0.00 

2MD79 

A 

1 

45 

54 

1.85 

0.16 

1.07 

0.38 

2MD79 

B 

0 

20 

24 

1.23 

0.21 

1.35 

-0.14 

2MD79 

C 

0 

18 

22 

0.87 

0.17 

0.69 

-0.32 

2MD79 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD81 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

2MD81 

A 

1 

57 

75 

1.76 

0.14 

0.83 

0.51 

2MD81 

B 

0 

7 

9 

0.33 

0.29 

0.56 

-0.30 

2MD81 

C 

0 

12 

16 

0.46 

0.21 

0.65 

-0.36 

2MD81 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD810 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2MD810 

A 

1 

59 

74 

2.67 

0.15 

0.91 

0.49 

2MD810 

B 

0 

9 

11 

1.33 

0.42 

1.51 

-0.26 

2MD810 

C 

0 

12 

15 

1.13 

0.31 

0.66 

-0.37 

2MD810 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD811 

* 

-1 

3921 

98 

1.52 

0.02 

0.00 

0.02 

2MD811 

A 

1 

59 

83 

1.64 

0.18 

0.88 

0.44 

2MD811 

B 

0 

6 

8 

0.02 

0.33 

0.63 

-0.28 

2MD811 

C 

0 

6 

8 

-0.18 

0.16 

0.41 

-0.32 

2MD811 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD812 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2MD812 

A 

1 

64 

76 

1.78 

0.15 

1.17 

0.32 

2MD812 

B 

0 

7 

8 

0.77 

0.25 

0.72 

-0.21 

2MD812 

C 

0 

13 

15 

1.01 

0.20 

0.98 

-0.21 

2MD812 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD813 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2MD813 

A 

1 

44 

64 

1.83 

0.15 

1.00 

0.34 

2MD813 

B 

0 

15 

22 

0.94 

0.28 

1.20 

-0.32 

2MD813 

C 

0 

10 

14 

1.33 

0.29 

1.51 

-0.09 

2MD813 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD82 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2MD82 

A 

1 

77 

79 

2.15 

0.12 

1.03 

0.38 

2MD82 

B 

0 

8 

8 

0.52 

0.28 

0.43 

-0.37 

2MD82 

C 

0 

13 

13 

1.48 

0.27 

1.26 

-0.15 

2MD82 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD83 

* 

-1 

3915 

98 

1.52 

0.02 

0.00 

0.02 

2MD83 

A 

1 

66 

86 

1.47 

0.09 

0.88 

0.46 

2MD83 

B 

0 

5 

6 

0.71 

0.25 

0.77 

-0.19 

2MD83 

C 

0 

6 

8 

0.10 

0.31 

0.46 

-0.42 

2MD83 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD84 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

2MD84 

A 

1 

65 

76 

1.92 

0.13 

0.88 

0.50 

2MD84 

B 

0 

12 

14 

0.61 

0.23 

0.67 

-0.36 

2MD84 

C 

0 

8 

9 

0.58 

0.21 

0.57 

-0.29 

2MD84 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD85 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2MD85 

A 

1 

51 

74 

2.22 

0.16 

1.12 

0.33 

2MD85 

B 

0 

13 

19 

1.34 

0.27 

1.06 

-0.28 

2MD85 

C 

0 

5 

7 

1.49 

0.52 

1.28 

-0.13 

2MD85 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD86 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.05 

2MD86 

A 

1 

57 

85 

2.33 

0.18 

1.02 

0.44 

2MD86 

B 

0 

8 

12 

0.83 

0.24 

0.68 

-0.32 

2MD86 

C 

0 

2 

3 

-0.41 

0.76 

0.20 

-0.31 

2MD86 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD87 

* 

-1 

3831 

96 

1.52 

0.02 

0.00 

0.01 

2MD87 

A 

1 

81 

50 

1.94 

0.13 

1.07 

0.44 

2MD87 

B 

0 

71 

44 

1.01 

0.10 

0.99 

-0.36 

2MD87 

C 

0 

9 

6 

0.58 

0.26 

0.56 

-0.19 

2MD87 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD88 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2MD88 

A 

1 

56 

84 

2.29 

0.17 

0.79 

0.58 

2MD88 

B 

0 

1 

1 

-0.07 

0.00 

0.26 

-0.17 

2MD88 

C 

0 

10 

15 

0.00 

0.15 

0.30 

-0.55 

2MD88 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD89 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

2MD89 

A 

1 

52 

79 

2.65 

0.16 

0.86 

0.55 

2MD89 

B 

0 

9 

14 

1.04 

0.26 

0.60 

-0.37 

2MD89 

C 

0 

5 

8 

0.55 

0.42 

0.41 

-0.37 

2MD89 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD91 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2MD91 

A 

1 

66 

94 

1.44 

0.14 

1.06 

0.04 

2MD91 

B 

0 

1 

1 

-0.25 

0.00 

0.30 

-0.18 

2MD91 

C 

0 

3 

4 

1.73 

0.58 

3.14 

0.06 

2MD91 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD910 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2MD910 

A 

1 

27 

30 

2.23 

0.27 

1.77 

0.23 

2MD910 

B 

0 

56 

62 

1.65 

0.14 

1.37 

-0.15 

2MD910 

C 

0 

8 

9 

1.32 

0.40 

0.93 

-0.12 

2MD910 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD911 

* 

-1 

3910 

98 

1.52 

0.02 

0.00 

0.00 

2MD911 

A 

1 

47 

57 

1.55 

0.17 

1.53 

0.10 

2MD911 

B 

0 

13 

16 

1.65 

0.24 

1.97 

0.08 

2MD911 

C 

0 

22 

27 

1.18 

0.16 

1.07 

-0.17 

2MD911 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD912 

* 

-1 

3834 

96 

1.50 

0.02 

0.00 

-0.05 

2MD912 

A 

1 

68 

43 

2.22 

0.18 

1.95 

0.24 

2MD912 

B 

0 

61 

39 

1.85 

0.13 

1.67 

0.00 

2MD912 

C 

0 

29 

18 

1.01 

0.20 

0.69 

-0.30 

2MD912 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD913 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

2MD913 

A 

1 

28 

37 

2.21 

0.23 

0.97 

0.52 

2MD913 

B 

0 

17 

22 

0.77 

0.18 

0.64 

-0.30 

2MD913 

C 

0 

31 

41 

1.07 

0.16 

0.92 

-0.25 

2MD913 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD914 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2MD914 

A 

1 

56 

70 

2.54 

0.18 

1.49 

0.29 

2MD914 

B 

0 

7 

9 

1.70 

0.56 

2.01 

-0.14 

2MD914 

C 

0 

17 

21 

1.72 

0.22 

1.04 

-0.23 

2MD914 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD915 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

2MD915 

A 

1 

17 

25 

2.85 

0.41 

1.06 

0.58 

2MD915 

B 

0 

31 

45 

1.03 

0.17 

0.87 

-0.22 

2MD915 

C 

0 

21 

30 

0.73 

0.24 

0.82 

-0.30 

2MD915 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD92 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2MD92 

A 

1 

70 

83 

1.79 

0.13 

0.97 

0.41 

2MD92 

B 

0 

10 

12 

0.44 

0.22 

0.57 

-0.36 

2MD92 

C 

0 

4 

5 

0.73 

0.25 

0.68 

-0.16 

2MD92 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD93 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2MD93 

A 

1 

51 

74 

1.81 

0.15 

0.98 

0.40 

2MD93 

B 

0 

7 

10 

0.25 

0.07 

0.35 

-0.42 

2MD93 

C 

0 

11 

16 

1.26 

0.21 

1.17 

-0.13 

2MD93 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD94 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2MD94 

A 

1 

53 

54 

2.32 

0.12 

0.95 

0.38 

2MD94 

B 

0 

20 

20 

1.99 

0.30 

2.10 

0.03 

2MD94 

C 

0 

25 

26 

1.04 

0.19 

0.66 

-0.46 

2MD94 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD95 

* 

-1 

3915 

98 

1.52 

0.02 

0.00 

0.02 

2MD95 

A 

1 

28 

36 

1.49 

0.15 

1.22 

0.16 

2MD95 

B 

0 

34 

44 

1.23 

0.13 

1.17 

-0.08 

2MD95 

C 

0 

15 

19 

1.16 

0.28 

1.35 

-0.09 

2MD95 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2MD96 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

2MD96 

A 

1 

66 

78 

1.86 

0.13 

0.95 

0.42 

2MD96 

B 

0 

16 

19 

0.57 

0.16 

0.60 

-0.44 

2MD96 

C 

0 

3 

4 

1.50 

0.64 

1.69 

-0.02 

2MD96 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD97 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2MD97 

A 

1 

32 

46 

2.69 

0.17 

0.80 

0.57 

2MD97 

B 

0 

24 

35 

0.97 

0.16 

0.46 

-0.66 

2MD97 

C 

0 

13 

19 

2.21 

0.16 

1.40 

0.09 

2MD97 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD98 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.05 

2MD98 

A 

1 

8 

12 

2.64 

0.56 

2.75 

0.15 

2MD98 

B 

0 

55 

82 

2.06 

0.18 

1.22 

0.00 

2MD98 

C 

0 

4 

6 

0.96 

0.99 

0.66 

-0.20 

2MD98 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2MD99 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2MD99 

A 

1 

57 

85 

2.21 

0.18 

0.85 

0.49 

2MD99 

B 

0 

8 

12 

0.27 

0.36 

0.62 

-0.41 

2MD99 

C 

0 

2 

3 

0.00 

0.07 

0.28 

-0.23 

2MD99 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT21 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

2NBT21 

A 

1 

61 

92 

2.43 

0.16 

0.89 

0.41 

2NBT21 

B 

0 

1 

2 

-0.16 

0.00 

0.18 

-0.23 

2NBT21 

C 

0 

4 

6 

0.52 

0.49 

0.53 

-0.33 

2NBT21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT210 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2NBT210 

A 

-1 

70 

100 

1.43 

0.13 

0.00 

0.00 

2NBT210 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT210 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT210 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT211 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2NBT211 

A 

1 

81 

89 

2.00 

0.12 

0.82 

0.49 

2NBT211 

B 

0 

3 

3 

0.31 

0.44 

0.45 

-0.23 

2NBT211 

C 

0 

7 

8 

0.03 

0.25 

0.34 

-0.43 

2NBT211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT212 

* 

-1 

3910 

98 

1.52 

0.02 

0.00 

0.00 

2NBT212 

A 

1 

73 

89 

1.59 

0.12 

0.95 

0.35 

2NBT212 

B 

0 

4 

5 

0.13 

0.46 

0.50 

-0.30 

2NBT212 

C 

0 

5 

6 

0.69 

0.25 

0.75 

-0.19 

2NBT212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT213 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

2NBT213 

A 

1 

67 

88 

1.58 

0.13 

0.89 

0.35 

2NBT213 

B 

0 

2 

3 

-0.62 

0.13 

0.20 

-0.29 

2NBT213 

C 

0 

7 

9 

0.58 

0.47 

1.56 

-0.23 

2NBT213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT214 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2NBT214 

A 

1 

72 

90 

2.45 

0.15 

0.94 

0.37 

2NBT214 

B 

0 

5 

6 

0.97 

0.65 

0.90 

-0.26 

2NBT214 

C 

0 

3 

4 

0.60 

0.13 

0.35 

-0.26 

2NBT214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT215 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

2NBT215 

A 

1 

59 

86 

1.59 

0.19 

0.97 

0.34 

2NBT215 

B 

0 

6 

9 

-0.35 

0.24 

0.39 

-0.37 

2NBT215 

C 

0 

4 

6 

1.03 

0.10 

1.31 

-0.06 

2NBT215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT216 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT216 

A 

1 

80 

95 

1.63 

0.13 

1.03 

0.18 

2NBT216 

B 

0 

1 

1 

0.44 

0.00 

0.53 

-0.11 

2NBT216 

C 

0 

3 

4 

0.70 

0.42 

0.80 

-0.15 

2NBT216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT217 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2NBT217 

A 

1 

63 

91 

1.66 

0.13 

0.97 

0.29 

2NBT217 

B 

0 

3 

4 

0.96 

0.47 

1.02 

-0.12 

2NBT217 

C 

0 

3 

4 

0.17 

0.15 

0.38 

-0.28 

2NBT217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT218 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT218 

A 

1 

90 

92 

2.06 

0.11 

0.90 

0.41 

2NBT218 

B 

0 

4 

4 

-0.36 

0.06 

0.17 

-0.42 

2NBT218 

C 

0 

4 

4 

1.10 

0.31 

0.84 

-0.15 

2NBT218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT219 

* 

-1 

3915 

98 

1.52 

0.02 

0.00 

0.02 

2NBT219 

A 

1 

67 

87 

1.45 

0.10 

0.91 

0.41 

2NBT219 

B 

0 

4 

5 

0.31 

0.24 

0.51 

-0.28 

2NBT219 

C 

0 

6 

8 

0.48 

0.36 

0.71 

-0.29 

2NBT219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT22 

* 

-1 

3831 

96 

1.52 

0.02 

0.00 

0.01 

2NBT22 

A 

1 

149 

93 

1.58 

0.09 

0.89 

0.40 

2NBT22 

B 

0 

8 

5 

-0.22 

0.22 

0.35 

-0.34 

2NBT22 

C 

0 

4 

2 

0.12 

0.41 

0.55 

-0.19 

2NBT22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT220 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT220 

A 

1 

58 

68 

1.93 

0.14 

0.97 

0.42 

2NBT220 

B 

0 

12 

14 

0.83 

0.21 

0.75 

-0.28 

2NBT220 

C 

0 

15 

18 

0.97 

0.26 

1.14 

-0.26 

2NBT220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT23 

* 

-1 

3728 

93 

1.51 

0.02 

0.00 

-0.01 

2NBT23 

A 

1 

226 

86 

1.75 

0.07 

0.92 

0.42 

2NBT23 

B 

0 

12 

5 

0.24 

0.17 

0.45 

-0.27 

2NBT23 

C 

0 

26 

10 

0.60 

0.15 

0.72 

-0.30 

2NBT23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT24 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT24 

A 

1 

60 

87 

2.19 

0.14 

0.93 

0.43 

2NBT24 

B 

0 

3 

4 

0.97 

0.76 

0.87 

-0.19 

2NBT24 

C 

0 

6 

9 

0.64 

0.18 

0.42 

-0.37 

2NBT24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT25 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.05 

2NBT25 

A 

1 

61 

91 

2.28 

0.17 

0.80 

0.47 

2NBT25 

B 

0 

4 

6 

0.11 

0.46 

0.40 

-0.35 

2NBT25 

C 

0 

2 

3 

-0.48 

0.69 

0.20 

-0.31 

2NBT25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT26 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT26 

A 

1 

46 

69 

2.49 

0.19 

0.78 

0.58 

2NBT26 

B 

0 

8 

12 

1.46 

0.39 

1.40 

-0.11 

2NBT26 

C 

0 

13 

19 

0.15 

0.18 

0.31 

-0.59 

2NBT26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT27 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

2NBT27 

A 

1 

62 

94 

2.38 

0.16 

0.98 

0.33 

2NBT27 

B 

0 

2 

3 

0.80 

0.57 

0.55 

-0.20 

2NBT27 

C 

0 

2 

3 

0.31 

0.46 

0.32 

-0.26 

2NBT27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT28 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2NBT28 

A 

1 

64 

91 

1.58 

0.13 

0.88 

0.44 

2NBT28 

B 

0 

1 

1 

-0.25 

0.00 

0.29 

-0.18 

2NBT28 

C 

0 

5 

7 

-0.15 

0.32 

0.42 

-0.39 

2NBT28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT29 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2NBT29 

A 

1 

89 

98 

1.84 

0.12 

0.95 

0.26 

2NBT29 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT29 

C 

0 

2 

2 

-0.30 

0.25 

0.23 

-0.26 

2NBT29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT31 

* 

-1 

3910 

98 

1.52 

0.02 

0.00 

0.00 

2NBT31 

A 

1 

70 

85 

1.65 

0.11 

0.84 

0.44 

2NBT31 

B 

0 

6 

7 

0.14 

0.44 

0.62 

-0.36 

2NBT31 

C 

0 

6 

7 

0.62 

0.37 

0.87 

-0.23 

2NBT31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT310 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

2NBT310 

A 

1 

57 

75 

1.68 

0.15 

1.01 

0.39 

2NBT310 

B 

0 

12 

16 

0.27 

0.17 

0.50 

-0.43 

2NBT310 

C 

0 

7 

9 

1.31 

0.19 

1.33 

-0.03 

2NBT310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT311 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2NBT311 

A 

1 

68 

85 

2.53 

0.14 

0.89 

0.43 

2NBT311 

B 

0 

8 

10 

1.06 

0.49 

1.06 

-0.31 

2NBT311 

C 

0 

4 

5 

0.70 

0.44 

0.46 

-0.28 

2NBT311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT312 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

2NBT312 

A 

1 

59 

86 

1.59 

0.19 

0.99 

0.34 

2NBT312 

B 

0 

4 

6 

0.84 

0.13 

1.09 

-0.09 

2NBT312 

C 

0 

6 

9 

-0.24 

0.24 

0.42 

-0.35 

2NBT312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT313 

* 

-1 

3839 

96 

1.50 

0.02 

0.00 

-0.05 

2NBT313 

A 

1 

142 

93 

1.99 

0.12 

0.94 

0.33 

2NBT313 

B 

0 

6 

4 

0.50 

0.40 

0.93 

-0.19 

2NBT313 

C 

0 

5 

3 

-0.33 

0.29 

0.29 

-0.28 

2NBT313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT314 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT314 

A 

1 

75 

89 

1.75 

0.13 

0.87 

0.42 

2NBT314 

B 

0 

3 

4 

0.40 

0.36 

0.54 

-0.20 

2NBT314 

C 

0 

6 

7 

0.06 

0.34 

0.46 

-0.36 

2NBT314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT315 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2NBT315 

A 

1 

62 

90 

1.70 

0.13 

0.95 

0.37 

2NBT315 

B 

0 

5 

7 

0.41 

0.13 

0.47 

-0.31 

2NBT315 

C 

0 

2 

3 

0.43 

0.13 

0.47 

-0.19 

2NBT315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT316 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT316 

A 

1 

81 

83 

2.13 

0.12 

0.99 

0.40 

2NBT316 

B 

0 

7 

7 

1.29 

0.44 

1.27 

-0.16 

2NBT316 

C 

0 

10 

10 

0.71 

0.29 

0.65 

-0.37 

2NBT316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT317 

* 

-1 

3917 

98 

1.52 

0.02 

0.00 

0.02 

2NBT317 

A 

1 

67 

89 

1.42 

0.10 

0.94 

0.35 

2NBT317 

B 

0 

2 

3 

1.13 

0.08 

1.07 

-0.04 

2NBT317 

C 

0 

6 

8 

0.26 

0.33 

0.57 

-0.37 

2NBT317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT318 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT318 

A 

1 

74 

87 

1.73 

0.13 

0.99 

0.29 

2NBT318 

B 

0 

5 

6 

0.77 

0.55 

1.20 

-0.18 

2NBT318 

C 

0 

6 

7 

0.75 

0.26 

0.77 

-0.21 

2NBT318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT319 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT319 

A 

1 

65 

94 

2.07 

0.14 

0.98 

0.23 

2NBT319 

B 

0 

1 

1 

2.14 

0.00 

1.92 

0.01 

2NBT319 

C 

0 

3 

4 

0.52 

0.51 

0.47 

-0.28 

2NBT319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT32 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

2NBT32 

A 

1 

62 

94 

2.25 

0.17 

0.86 

0.39 

2NBT32 

B 

0 

3 

5 

0.04 

0.63 

0.36 

-0.33 

2NBT32 

C 

0 

1 

2 

-0.19 

0.00 

0.21 

-0.21 

2NBT32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT320 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT320 

A 

1 

61 

91 

2.10 

0.18 

0.93 

0.40 

2NBT320 

B 

0 

2 

3 

0.52 

0.72 

0.67 

-0.17 

2NBT320 

C 

0 

4 

6 

-0.20 

0.13 

0.26 

-0.36 

2NBT320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT33 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

2NBT33 

A 

1 

50 

76 

2.60 

0.17 

0.93 

0.44 

2NBT33 

B 

0 

4 

6 

0.49 

0.50 

0.39 

-0.34 

2NBT33 

C 

0 

12 

18 

1.49 

0.34 

1.22 

-0.28 

2NBT33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT34 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2NBT34 

A 

1 

54 

77 

1.69 

0.14 

0.96 

0.43 

2NBT34 

B 

0 

13 

19 

0.68 

0.27 

1.08 

-0.32 

2NBT34 

C 

0 

3 

4 

-0.02 

0.28 

0.34 

-0.28 

2NBT34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT35 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2NBT35 

A 

1 

73 

80 

2.10 

0.13 

0.81 

0.52 

2NBT35 

B 

0 

11 

12 

0.83 

0.27 

0.75 

-0.30 

2NBT35 

C 

0 

7 

8 

0.12 

0.20 

0.30 

-0.41 

2NBT35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT36 

* 

-1 

3910 

98 

1.52 

0.02 

0.00 

0.00 

2NBT36 

A 

1 

69 

84 

1.68 

0.11 

0.84 

0.47 

2NBT36 

B 

0 

12 

15 

0.41 

0.22 

0.60 

-0.42 

2NBT36 

C 

0 

1 

1 

-0.49 

0.00 

0.19 

-0.21 

2NBT36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT37 

* 

-1 

3835 

96 

1.50 

0.02 

0.00 

-0.04 

2NBT37 

A 

1 

105 

67 

2.19 

0.11 

0.99 

0.46 

2NBT37 

B 

0 

40 

25 

0.98 

0.13 

0.73 

-0.42 

2NBT37 

C 

0 

12 

8 

1.29 

0.26 

1.14 

-0.13 

2NBT37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT38 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

2NBT38 

A 

1 

57 

75 

1.74 

0.15 

0.90 

0.47 

2NBT38 

B 

0 

12 

16 

0.15 

0.15 

0.42 

-0.48 

2NBT38 

C 

0 

7 

9 

1.07 

0.24 

1.10 

-0.10 

2NBT38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT39 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2NBT39 

A 

1 

70 

88 

2.51 

0.15 

1.03 

0.44 

2NBT39 

B 

0 

7 

9 

0.82 

0.33 

0.55 

-0.35 

2NBT39 

C 

0 

3 

4 

0.64 

0.08 

0.34 

-0.25 

2NBT39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT51 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

2NBT51 

A 

1 

65 

94 

1.45 

0.18 

1.04 

0.18 

2NBT51 

B 

0 

4 

6 

0.34 

0.25 

0.78 

-0.18 

2NBT51 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT52 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT52 

A 

1 

65 

77 

1.87 

0.14 

0.89 

0.46 

2NBT52 

B 

0 

16 

19 

0.59 

0.22 

0.72 

-0.42 

2NBT52 

C 

0 

3 

4 

0.64 

0.38 

0.61 

-0.16 

2NBT52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT53 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2NBT53 

A 

1 

55 

80 

1.82 

0.14 

0.91 

0.48 

2NBT53 

B 

0 

8 

12 

0.53 

0.14 

0.51 

-0.36 

2NBT53 

C 

0 

6 

9 

0.62 

0.24 

0.61 

-0.28 

2NBT53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT54 

* 

-1 

3894 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT54 

A 

1 

85 

87 

2.14 

0.11 

0.90 

0.50 

2NBT54 

B 

0 

10 

10 

0.27 

0.17 

0.33 

-0.50 

2NBT54 

C 

0 

3 

3 

1.28 

0.57 

1.14 

-0.10 

2NBT54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT55 

* 

-1 

3917 

98 

1.52 

0.02 

0.00 

0.02 

2NBT55 

A 

1 

57 

76 

1.50 

0.11 

0.97 

0.37 

2NBT55 

B 

0 

9 

12 

0.77 

0.21 

0.80 

-0.24 

2NBT55 

C 

0 

9 

12 

0.77 

0.29 

0.88 

-0.24 

2NBT55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT61 

* 

-1 

3836 

96 

1.50 

0.02 

0.00 

-0.04 

2NBT61 

A 

1 

135 

87 

1.94 

0.10 

0.96 

0.30 

2NBT61 

B 

0 

8 

5 

0.87 

0.34 

0.87 

-0.19 

2NBT61 

C 

0 

13 

8 

0.95 

0.34 

1.38 

-0.22 

2NBT61 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT610 

* 

-1 

3839 

96 

1.51 

0.02 

0.00 

-0.01 

2NBT610 

A 

1 

104 

68 

1.99 

0.10 

0.85 

0.54 

2NBT610 

B 

0 

27 

18 

0.92 

0.15 

0.86 

-0.27 

2NBT610 

C 

0 

22 

14 

0.42 

0.13 

0.45 

-0.43 

2NBT610 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT611 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT611 

A 

1 

62 

73 

1.84 

0.14 

1.04 

0.33 

2NBT611 

B 

0 

20 

24 

1.05 

0.21 

1.19 

-0.27 

2NBT611 

C 

0 

3 

4 

0.58 

0.51 

0.58 

-0.17 

2NBT611 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT612 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT612 

A 

1 

59 

86 

2.15 

0.15 

1.07 

0.32 

2NBT612 

B 

0 

9 

13 

1.23 

0.23 

0.86 

-0.26 

2NBT612 

C 

0 

1 

1 

0.10 

0.00 

0.22 

-0.20 

2NBT612 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT613 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

2NBT613 

A 

1 

62 

94 

2.19 

0.18 

1.09 

0.21 

2NBT613 

B 

0 

2 

3 

0.89 

0.53 

0.70 

-0.16 

2NBT613 

C 

0 

2 

3 

1.01 

0.79 

0.91 

-0.14 

2NBT613 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT614 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT614 

A 

1 

43 

64 

2.57 

0.20 

0.79 

0.60 

2NBT614 

B 

0 

9 

13 

0.83 

0.40 

0.84 

-0.29 

2NBT614 

C 

0 

15 

22 

0.67 

0.23 

0.54 

-0.46 

2NBT614 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT615 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

2NBT615 

A 

1 

55 

83 

2.47 

0.18 

1.14 

0.33 

2NBT615 

B 

0 

8 

12 

1.58 

0.34 

1.39 

-0.19 

2NBT615 

C 

0 

3 

5 

0.48 

0.46 

0.36 

-0.29 

2NBT615 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT616 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2NBT616 

A 

1 

55 

79 

1.67 

0.14 

0.93 

0.41 

2NBT616 

B 

0 

11 

16 

0.38 

0.29 

0.79 

-0.41 

2NBT616 

C 

0 

4 

6 

1.01 

0.57 

1.35 

-0.09 

2NBT616 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT617 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2NBT617 

A 

1 

71 

78 

2.06 

0.14 

1.02 

0.42 

2NBT617 

B 

0 

12 

13 

0.85 

0.21 

0.67 

-0.31 

2NBT617 

C 

0 

8 

9 

0.83 

0.26 

0.66 

-0.25 

2NBT617 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT618 

* 

-1 

3910 

98 

1.52 

0.02 

0.00 

0.00 

2NBT618 

A 

1 

64 

78 

1.70 

0.12 

0.98 

0.42 

2NBT618 

B 

0 

10 

12 

0.53 

0.28 

0.77 

-0.34 

2NBT618 

C 

0 

8 

10 

0.81 

0.14 

0.71 

-0.21 

2NBT618 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT619 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

2NBT619 

A 

1 

63 

83 

1.62 

0.14 

0.91 

0.37 

2NBT619 

B 

0 

4 

5 

0.06 

0.25 

0.41 

-0.28 

2NBT619 

C 

0 

9 

12 

0.67 

0.38 

1.20 

-0.24 

2NBT619 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT62 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2NBT62 

A 

1 

63 

79 

2.45 

0.16 

1.14 

0.24 

2NBT62 

B 

0 

9 

11 

1.40 

0.51 

1.43 

-0.24 

2NBT62 

C 

0 

8 

10 

2.04 

0.44 

2.12 

-0.06 

2NBT62 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT620 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

2NBT620 

A 

1 

42 

61 

1.94 

0.22 

0.91 

0.47 

2NBT620 

B 

0 

14 

20 

0.49 

0.31 

1.38 

-0.31 

2NBT620 

C 

0 

13 

19 

0.58 

0.27 

0.95 

-0.27 

2NBT620 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT63 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT63 

A 

1 

72 

86 

1.72 

0.14 

1.02 

0.29 

2NBT63 

B 

0 

5 

6 

1.11 

0.29 

1.09 

-0.10 

2NBT63 

C 

0 

7 

8 

0.48 

0.32 

0.65 

-0.29 

2NBT63 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT64 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2NBT64 

A 

1 

51 

74 

1.76 

0.14 

1.03 

0.30 

2NBT64 

B 

0 

8 

12 

1.20 

0.31 

1.36 

-0.13 

2NBT64 

C 

0 

10 

14 

0.90 

0.34 

1.30 

-0.26 

2NBT64 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT65 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT65 

A 

1 

60 

62 

2.28 

0.13 

1.05 

0.41 

2NBT65 

B 

0 

25 

26 

1.34 

0.24 

1.22 

-0.30 

2NBT65 

C 

0 

12 

12 

1.32 

0.26 

0.85 

-0.20 

2NBT65 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT66 

* 

-1 

3917 

98 

1.52 

0.02 

0.00 

0.02 

2NBT66 

A 

1 

47 

63 

1.47 

0.12 

1.19 

0.23 

2NBT66 

B 

0 

12 

16 

1.18 

0.26 

1.42 

-0.07 

2NBT66 

C 

0 

16 

21 

0.98 

0.18 

1.02 

-0.21 

2NBT66 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT67 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT67 

A 

1 

56 

66 

1.99 

0.15 

0.95 

0.47 

2NBT67 

B 

0 

10 

12 

0.73 

0.23 

0.63 

-0.28 

2NBT67 

C 

0 

19 

22 

0.94 

0.19 

0.87 

-0.32 

2NBT67 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT68 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT68 

A 

1 

45 

65 

2.33 

0.18 

1.27 

0.40 

2NBT68 

B 

0 

7 

10 

1.63 

0.19 

0.91 

-0.11 

2NBT68 

C 

0 

17 

25 

1.29 

0.19 

0.76 

-0.36 

2NBT68 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT69 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

2NBT69 

A 

1 

51 

77 

2.40 

0.18 

1.03 

0.38 

2NBT69 

B 

0 

8 

12 

1.00 

0.45 

0.96 

-0.30 

2NBT69 

C 

0 

7 

11 

1.33 

0.48 

1.52 

-0.20 

2NBT69 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT71 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT71 

A 

1 

39 

58 

2.72 

0.19 

0.67 

0.65 

2NBT71 

B 

0 

24 

36 

0.86 

0.20 

0.65 

-0.54 

2NBT71 

C 

0 

4 

6 

0.30 

0.52 

0.39 

-0.28 

2NBT71 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT710 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

2NBT710 

A 

1 

31 

47 

2.83 

0.24 

1.33 

0.39 

2NBT710 

B 

0 

11 

17 

1.05 

0.37 

0.61 

-0.41 

2NBT710 

C 

0 

24 

36 

2.12 

0.19 

1.29 

-0.09 

2NBT710 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT711 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2NBT711 

A 

1 

26 

37 

2.19 

0.21 

0.95 

0.53 

2NBT711 

B 

0 

16 

23 

1.04 

0.20 

0.78 

-0.19 

2NBT711 

C 

0 

28 

40 

0.95 

0.18 

0.81 

-0.35 

2NBT711 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT712 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2NBT712 

A 

1 

48 

53 

2.27 

0.19 

1.32 

0.42 

2NBT712 

B 

0 

32 

35 

1.14 

0.15 

0.83 

-0.40 

2NBT712 

C 

0 

11 

12 

1.63 

0.17 

1.08 

-0.05 

2NBT712 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT713 

* 

-1 

3910 

98 

1.52 

0.02 

0.00 

0.00 

2NBT713 

A 

1 

30 

37 

1.59 

0.25 

2.01 

0.09 

2NBT713 

B 

0 

30 

37 

1.36 

0.15 

1.10 

-0.08 

2NBT713 

C 

0 

22 

27 

1.45 

0.15 

1.14 

-0.01 

2NBT713 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT714 

* 

-1 

3857 

97 

1.50 

0.02 

0.00 

-0.06 

2NBT714 

A 

1 

94 

70 

2.42 

0.14 

1.15 

0.47 

2NBT714 

B 

0 

15 

11 

0.89 

0.20 

0.62 

-0.27 

2NBT714 

C 

0 

26 

19 

1.00 

0.22 

0.97 

-0.33 

2NBT714 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT715 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

2NBT715 

A 

1 

29 

38 

1.91 

0.27 

1.59 

0.33 

2NBT715 

B 

0 

32 

42 

1.20 

0.16 

1.18 

-0.17 

2NBT715 

C 

0 

15 

20 

0.96 

0.15 

0.69 

-0.20 

2NBT715 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT716 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2NBT716 

A 

1 

54 

68 

2.59 

0.18 

1.49 

0.33 

2NBT716 

B 

0 

6 

8 

2.61 

0.39 

2.80 

0.07 

2NBT716 

C 

0 

20 

25 

1.39 

0.21 

0.83 

-0.40 

2NBT716 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT717 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

2NBT717 

A 

1 

46 

67 

1.89 

0.21 

0.99 

0.49 

2NBT717 

B 

0 

14 

20 

0.47 

0.21 

0.89 

-0.32 

2NBT717 

C 

0 

9 

13 

0.24 

0.31 

0.79 

-0.31 

2NBT717 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT718 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT718 

A 

1 

25 

30 

2.61 

0.24 

1.07 

0.58 

2NBT718 

B 

0 

54 

64 

1.12 

0.12 

0.78 

-0.53 

2NBT718 

C 

0 

5 

6 

1.35 

0.19 

0.71 

-0.05 

2NBT718 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT719 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2NBT719 

A 

1 

28 

41 

1.72 

0.22 

1.61 

0.12 

2NBT719 

B 

0 

25 

36 

1.39 

0.18 

1.13 

-0.13 

2NBT719 

C 

0 

16 

23 

1.58 

0.28 

1.75 

0.01 

2NBT719 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT72 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT72 

A 

1 

49 

51 

2.47 

0.14 

0.99 

0.49 

2NBT72 

B 

0 

9 

9 

1.04 

0.39 

0.70 

-0.25 

2NBT72 

C 

0 

39 

40 

1.43 

0.16 

0.96 

-0.36 

2NBT72 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT720 

* 

-1 

3917 

98 

1.52 

0.02 

0.00 

0.02 

2NBT720 

A 

1 

31 

41 

1.68 

0.15 

0.97 

0.36 

2NBT720 

B 

0 

4 

5 

0.63 

0.36 

0.56 

-0.20 

2NBT720 

C 

0 

40 

53 

1.11 

0.12 

1.02 

-0.27 

2NBT720 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT73 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT73 

A 

1 

66 

78 

1.84 

0.13 

0.99 

0.38 

2NBT73 

B 

0 

12 

14 

0.82 

0.32 

1.42 

-0.28 

2NBT73 

C 

0 

7 

8 

0.79 

0.16 

0.66 

-0.22 

2NBT73 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT74 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT74 

A 

1 

55 

80 

2.20 

0.15 

1.04 

0.34 

2NBT74 

B 

0 

2 

3 

1.09 

0.15 

0.57 

-0.14 

2NBT74 

C 

0 

12 

17 

1.25 

0.27 

0.91 

-0.30 

2NBT74 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT75 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

2NBT75 

A 

1 

35 

53 

2.95 

0.17 

0.68 

0.65 

2NBT75 

B 

0 

22 

33 

1.34 

0.26 

1.00 

-0.40 

2NBT75 

C 

0 

9 

14 

0.74 

0.26 

0.36 

-0.40 

2NBT75 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT76 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT76 

A 

1 

46 

69 

2.38 

0.21 

1.17 

0.47 

2NBT76 

B 

0 

20 

30 

0.94 

0.21 

0.80 

-0.44 

2NBT76 

C 

0 

1 

1 

0.06 

0.00 

0.23 

-0.16 

2NBT76 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT77 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

2NBT77 

A 

1 

43 

65 

2.65 

0.20 

1.21 

0.38 

2NBT77 

B 

0 

15 

23 

1.67 

0.29 

1.17 

-0.24 

2NBT77 

C 

0 

8 

12 

1.39 

0.40 

0.93 

-0.25 

2NBT77 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT78 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2NBT78 

A 

1 

39 

56 

1.86 

0.17 

1.03 

0.44 

2NBT78 

B 

0 

4 

6 

-0.09 

0.39 

0.31 

-0.34 

2NBT78 

C 

0 

27 

39 

1.03 

0.17 

1.00 

-0.28 

2NBT78 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT79 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2NBT79 

A 

1 

52 

57 

2.17 

0.18 

1.40 

0.37 

2NBT79 

B 

0 

16 

18 

0.93 

0.19 

0.60 

-0.33 

2NBT79 

C 

0 

23 

25 

1.54 

0.15 

1.17 

-0.13 

2NBT79 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT81 

* 

-1 

3910 

98 

1.52 

0.02 

0.00 

0.00 

2NBT81 

A 

1 

51 

62 

1.75 

0.14 

1.01 

0.35 

2NBT81 

B 

0 

27 

33 

1.00 

0.18 

1.03 

-0.32 

2NBT81 

C 

0 

4 

5 

0.99 

0.12 

0.72 

-0.11 

2NBT81 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT810 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

2NBT810 

A 

1 

57 

75 

1.78 

0.14 

0.82 

0.53 

2NBT810 

B 

0 

15 

20 

0.33 

0.17 

0.55 

-0.47 

2NBT810 

C 

0 

4 

5 

0.51 

0.46 

0.71 

-0.19 

2NBT810 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT811 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2NBT811 

A 

1 

75 

94 

2.41 

0.14 

0.91 

0.36 

2NBT811 

B 

0 

3 

4 

1.15 

0.25 

0.68 

-0.17 

2NBT811 

C 

0 

2 

3 

-0.53 

0.51 

0.13 

-0.35 

2NBT811 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT812 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

2NBT812 

A 

1 

59 

86 

1.54 

0.19 

1.05 

0.26 

2NBT812 

B 

0 

7 

10 

0.36 

0.19 

0.74 

-0.24 

2NBT812 

C 

0 

3 

4 

0.70 

1.15 

3.24 

-0.10 

2NBT812 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT813 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT813 

A 

1 

65 

77 

1.90 

0.13 

0.86 

0.51 

2NBT813 

B 

0 

10 

12 

0.78 

0.17 

0.69 

-0.25 

2NBT813 

C 

0 

9 

11 

0.17 

0.24 

0.42 

-0.42 

2NBT813 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT814 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2NBT814 

A 

1 

62 

90 

1.66 

0.13 

1.00 

0.27 

2NBT814 

B 

0 

4 

6 

0.96 

0.32 

0.92 

-0.14 

2NBT814 

C 

0 

3 

4 

0.43 

0.13 

0.48 

-0.23 

2NBT814 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT815 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT815 

A 

1 

89 

92 

2.03 

0.11 

0.94 

0.35 

2NBT815 

B 

0 

5 

5 

0.90 

0.59 

1.13 

-0.21 

2NBT815 

C 

0 

3 

3 

0.16 

0.34 

0.32 

-0.28 

2NBT815 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT816 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.02 

2NBT816 

A 

1 

58 

78 

1.51 

0.10 

0.92 

0.41 

2NBT816 

B 

0 

12 

16 

0.94 

0.20 

0.99 

-0.21 

2NBT816 

C 

0 

4 

5 

-0.11 

0.35 

0.33 

-0.41 

2NBT816 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT817 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT817 

A 

1 

71 

84 

1.82 

0.13 

0.90 

0.42 

2NBT817 

B 

0 

9 

11 

0.66 

0.30 

0.81 

-0.29 

2NBT817 

C 

0 

5 

6 

0.30 

0.22 

0.44 

-0.29 

2NBT817 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT818 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT818 

A 

1 

59 

86 

2.23 

0.14 

0.89 

0.49 

2NBT818 

B 

0 

5 

7 

1.15 

0.25 

0.72 

-0.21 

2NBT818 

C 

0 

5 

7 

0.15 

0.13 

0.24 

-0.46 

2NBT818 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT819 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

2NBT819 

A 

1 

60 

91 

2.30 

0.17 

0.86 

0.44 

2NBT819 

B 

0 

2 

3 

0.87 

0.38 

0.61 

-0.16 

2NBT819 

C 

0 

4 

6 

-0.13 

0.39 

0.25 

-0.41 

2NBT819 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT82 

* 

-1 

3851 

96 

1.50 

0.02 

0.00 

-0.04 

2NBT82 

A 

1 

131 

93 

1.89 

0.11 

1.02 

0.24 

2NBT82 

B 

0 

5 

4 

0.91 

0.53 

1.31 

-0.13 

2NBT82 

C 

0 

5 

4 

0.38 

0.19 

0.49 

-0.21 

2NBT82 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT820 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT820 

A 

1 

58 

87 

2.17 

0.18 

0.96 

0.44 

2NBT820 

B 

0 

3 

4 

0.53 

0.54 

0.67 

-0.20 

2NBT820 

C 

0 

6 

9 

0.15 

0.25 

0.39 

-0.38 

2NBT820 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT83 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

2NBT83 

A 

1 

57 

86 

2.50 

0.16 

0.88 

0.44 

2NBT83 

B 

0 

5 

8 

0.80 

0.48 

0.63 

-0.32 

2NBT83 

C 

0 

4 

6 

0.81 

0.65 

0.86 

-0.28 

2NBT83 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT84 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2NBT84 

A 

1 

54 

77 

1.65 

0.15 

1.10 

0.36 

2NBT84 

B 

0 

4 

6 

0.89 

0.41 

0.96 

-0.12 

2NBT84 

C 

0 

12 

17 

0.64 

0.23 

0.83 

-0.32 

2NBT84 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT85 

* 

-1 

3901 

98 

1.51 

0.02 

0.00 

-0.03 

2NBT85 

A 

1 

71 

78 

1.99 

0.13 

0.96 

0.30 

2NBT85 

B 

0 

4 

4 

-0.34 

0.11 

0.17 

-0.38 

2NBT85 

C 

0 

16 

18 

1.48 

0.28 

1.81 

-0.12 

2NBT85 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT86 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.01 

2NBT86 

A 

1 

60 

75 

1.74 

0.13 

0.90 

0.47 

2NBT86 

B 

0 

12 

15 

0.75 

0.23 

0.77 

-0.29 

2NBT86 

C 

0 

8 

10 

0.39 

0.16 

0.47 

-0.34 

2NBT86 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT87 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

2NBT87 

A 

1 

41 

54 

1.96 

0.18 

0.93 

0.50 

2NBT87 

B 

0 

15 

20 

0.83 

0.23 

0.85 

-0.26 

2NBT87 

C 

0 

20 

26 

0.79 

0.16 

0.74 

-0.33 

2NBT87 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT88 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2NBT88 

A 

1 

41 

51 

2.70 

0.22 

1.96 

0.32 

2NBT88 

B 

0 

30 

38 

2.13 

0.18 

1.40 

-0.09 

2NBT88 

C 

0 

9 

11 

0.98 

0.18 

0.33 

-0.36 

2NBT88 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT89 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

2NBT89 

A 

1 

45 

65 

1.93 

0.21 

0.89 

0.51 

2NBT89 

B 

0 

9 

13 

0.03 

0.25 

0.48 

-0.36 

2NBT89 

C 

0 

15 

22 

0.56 

0.23 

0.94 

-0.30 

2NBT89 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT91 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT91 

A 

1 

70 

83 

1.83 

0.13 

0.85 

0.49 

2NBT91 

B 

0 

4 

5 

0.10 

0.38 

0.40 

-0.29 

2NBT91 

C 

0 

10 

12 

0.40 

0.21 

0.55 

-0.37 

2NBT91 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT910 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2NBT910 

A 

1 

37 

54 

2.09 

0.15 

0.81 

0.53 

2NBT910 

B 

0 

14 

20 

1.21 

0.26 

1.24 

-0.17 

2NBT910 

C 

0 

18 

26 

0.78 

0.19 

0.74 

-0.45 

2NBT910 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT911 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT911 

A 

1 

71 

73 

2.15 

0.12 

1.11 

0.34 

2NBT911 

B 

0 

12 

12 

1.62 

0.30 

1.56 

-0.10 

2NBT911 

C 

0 

14 

14 

1.00 

0.31 

0.96 

-0.33 

2NBT911 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT912 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.02 

2NBT912 

A 

1 

43 

58 

1.53 

0.14 

1.13 

0.28 

2NBT912 

B 

0 

11 

15 

1.13 

0.19 

1.04 

-0.10 

2NBT912 

C 

0 

20 

27 

1.01 

0.17 

0.99 

-0.23 

2NBT912 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT913 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT913 

A 

1 

73 

86 

1.84 

0.12 

0.84 

0.51 

2NBT913 

B 

0 

5 

6 

0.22 

0.23 

0.41 

-0.31 

2NBT913 

C 

0 

7 

8 

0.16 

0.14 

0.37 

-0.38 

2NBT913 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT914 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT914 

A 

1 

65 

94 

2.05 

0.14 

1.06 

0.16 

2NBT914 

B 

0 

2 

3 

1.51 

0.42 

1.12 

-0.07 

2NBT914 

C 

0 

2 

3 

1.04 

0.53 

0.73 

-0.15 

2NBT914 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT915 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

2NBT915 

A 

1 

40 

61 

2.55 

0.21 

1.21 

0.40 

2NBT915 

B 

0 

11 

17 

1.73 

0.40 

1.45 

-0.12 

2NBT915 

C 

0 

15 

23 

1.22 

0.29 

0.95 

-0.35 

2NBT915 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT916 

* 

-1 

3925 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT916 

A 

1 

59 

88 

2.12 

0.18 

0.91 

0.39 

2NBT916 

B 

0 

4 

6 

1.08 

0.72 

1.67 

-0.14 

2NBT916 

C 

0 

4 

6 

-0.33 

0.12 

0.22 

-0.39 

2NBT916 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT917 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

2NBT917 

A 

1 

59 

89 

2.48 

0.16 

0.91 

0.45 

2NBT917 

B 

0 

1 

2 

0.91 

0.00 

0.49 

-0.13 

2NBT917 

C 

0 

6 

9 

0.46 

0.30 

0.39 

-0.43 

2NBT917 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT918 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2NBT918 

A 

1 

60 

86 

1.57 

0.14 

0.99 

0.30 

2NBT918 

B 

0 

5 

7 

0.26 

0.31 

0.55 

-0.29 

2NBT918 

C 

0 

5 

7 

0.97 

0.60 

1.63 

-0.11 

2NBT918 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT919 

* 

-1 

3902 

98 

1.51 

0.02 

0.00 

-0.03 

2NBT919 

A 

1 

78 

87 

2.00 

0.12 

0.86 

0.48 

2NBT919 

B 

0 

7 

8 

0.63 

0.28 

0.63 

-0.28 

2NBT919 

C 

0 

5 

6 

-0.07 

0.24 

0.28 

-0.38 

2NBT919 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT92 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.01 

2NBT92 

A 

1 

60 

75 

1.69 

0.13 

1.01 

0.40 

2NBT92 

B 

0 

16 

20 

0.78 

0.17 

0.78 

-0.32 

2NBT92 

C 

0 

4 

5 

0.58 

0.38 

0.63 

-0.19 

2NBT92 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT920 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

2NBT920 

A 

1 

57 

75 

1.72 

0.14 

0.84 

0.44 

2NBT920 

B 

0 

5 

7 

0.44 

0.29 

0.60 

-0.23 

2NBT920 

C 

0 

14 

18 

0.58 

0.32 

1.45 

-0.35 

2NBT920 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT93 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2NBT93 

A 

1 

68 

85 

2.57 

0.14 

0.83 

0.50 

2NBT93 

B 

0 

5 

6 

1.27 

0.37 

0.81 

-0.20 

2NBT93 

C 

0 

7 

9 

0.34 

0.35 

0.34 

-0.46 

2NBT93 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT94 

* 

-1 

3818 

96 

1.51 

0.02 

0.00 

-0.02 

2NBT94 

A 

1 

134 

77 

1.89 

0.10 

1.02 

0.40 

2NBT94 

B 

0 

21 

12 

0.91 

0.20 

0.96 

-0.24 

2NBT94 

C 

0 

19 

11 

0.73 

0.16 

0.70 

-0.28 

2NBT94 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT95 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

2NBT95 

A 

1 

36 

52 

1.97 

0.27 

1.29 

0.42 

2NBT95 

B 

0 

16 

23 

0.72 

0.19 

0.85 

-0.25 

2NBT95 

C 

0 

17 

25 

0.77 

0.25 

1.03 

-0.24 

2NBT95 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2NBT96 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2NBT96 

A 

1 

61 

73 

1.94 

0.14 

0.86 

0.51 

2NBT96 

B 

0 

12 

14 

0.53 

0.28 

0.70 

-0.37 

2NBT96 

C 

0 

11 

13 

0.73 

0.17 

0.64 

-0.29 

2NBT96 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT97 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

2NBT97 

A 

1 

50 

72 

1.93 

0.13 

0.80 

0.57 

2NBT97 

B 

0 

5 

7 

0.85 

0.49 

1.14 

-0.19 

2NBT97 

C 

0 

14 

20 

0.52 

0.14 

0.52 

-0.50 

2NBT97 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT98 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

2NBT98 

A 

1 

68 

70 

2.34 

0.12 

0.95 

0.58 

2NBT98 

B 

0 

8 

8 

0.77 

0.27 

0.51 

-0.31 

2NBT98 

C 

0 

21 

22 

0.98 

0.17 

0.65 

-0.44 

2NBT98 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2NBT99 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.02 

2NBT99 

A 

1 

64 

86 

1.40 

0.10 

1.00 

0.21 

2NBT99 

B 

0 

8 

11 

0.62 

0.32 

0.87 

-0.29 

2NBT99 

C 

0 

2 

3 

1.92 

0.21 

2.34 

0.12 

2NBT99 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A11 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

20A11 

A 

1 

34 

40 

2.38 

0.19 

0.82 

0.56 

20A11 

B 

0 

29 

34 

1.12 

0.15 

0.80 

-0.31 

20A11 

C 

0 

22 

26 

1.05 

0.19 

0.79 

-0.29 

20A11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A12 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

20A12 

A 

1 

57 

83 

2.21 

0.15 

1.04 

0.39 

20A12 

B 

0 

6 

9 

1.12 

0.32 

0.78 

-0.24 

20A12 

C 

0 

6 

9 

0.93 

0.29 

0.63 

-0.29 

20A12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A13 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

20A13 

A 

1 

43 

65 

2.55 

0.21 

1.50 

0.43 

20A13 

B 

0 

4 

6 

1.11 

0.57 

0.83 

-0.19 

20A13 

C 

0 

19 

29 

1.34 

0.22 

0.94 

-0.36 

20A13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A14 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.04 

20A14 

A 

1 

45 

68 

2.45 

0.21 

1.05 

0.53 

20A14 

B 

0 

12 

18 

1.11 

0.24 

0.88 

-0.26 

20A14 

C 

0 

9 

14 

0.36 

0.34 

0.56 

-0.42 

20A14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A15 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

20A15 

A 

1 

43 

65 

2.71 

0.20 

1.23 

0.45 

20A15 

B 

0 

8 

12 

1.04 

0.43 

0.86 

-0.34 

20A15 

C 

0 

15 

23 

1.68 

0.21 

1.01 

-0.24 

20A15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A21 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

20A21 

A 

1 

46 

66 

1.87 

0.15 

0.87 

0.54 

20A21 

B 

0 

6 

9 

-0.03 

0.34 

0.39 

-0.40 

20A21 

C 

0 

18 

26 

0.80 

0.18 

0.81 

-0.33 

20A21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2OA210 

* 

-1 

3902 

98 

1.51 

0.02 

0.00 

-0.03 

2OA210 

A 

1 

79 

88 

1.90 

0.13 

1.05 

0.27 

2OA210 

B 

0 

6 

7 

0.49 

0.31 

0.55 

-0.29 

2OA210 

C 

0 

5 

6 

1.41 

0.30 

1.36 

-0.07 

2OA210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A211 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.01 

20A211 

A 

1 

69 

86 

1.59 

0.12 

1.02 

0.32 

20A211 

B 

0 

6 

8 

0.88 

0.32 

1.01 

-0.16 

20A211 

C 

0 

5 

6 

0.34 

0.23 

0.50 

-0.28 

20A211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A212 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

20A212 

A 

1 

64 

84 

1.62 

0.14 

0.90 

0.39 

20A212 

B 

0 

7 

9 

0.53 

0.42 

1.07 

-0.25 

20A212 

C 

0 

5 

7 

0.15 

0.24 

0.46 

-0.29 

20A212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A213 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

20A213 

A 

1 

70 

88 

2.54 

0.14 

0.95 

0.50 

20A213 

B 

0 

2 

3 

-0.08 

0.30 

0.17 

-0.29 

20A213 

C 

0 

8 

10 

0.72 

0.20 

0.42 

-0.40 

20A213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A214 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

20A214 

A 

1 

26 

38 

2.17 

0.32 

1.27 

0.42 

20A214 

B 

0 

23 

33 

0.96 

0.24 

1.30 

-0.21 

20A214 

C 

0 

20 

29 

0.85 

0.24 

1.13 

-0.23 

20A214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A215 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

20A215 

A 

1 

23 

27 

1.74 

0.23 

1.72 

0.08 

20A215 

B 

0 

42 

50 

1.68 

0.19 

2.02 

0.09 

20A215 

C 

0 

19 

23 

1.17 

0.22 

0.77 

-0.19 

20A215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A216 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

20A216 

A 

1 

52 

75 

1.80 

0.15 

0.99 

0.38 

20A216 

B 

0 

8 

12 

0.95 

0.20 

0.80 

-0.21 

20A216 

C 

0 

9 

13 

0.79 

0.30 

0.95 

-0.29 

20A216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A217 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

20A217 

A 

1 

90 

93 

2.01 

0.12 

1.00 

0.29 

20A217 

B 

0 

6 

6 

0.93 

0.36 

0.85 

-0.22 

20A217 

C 

0 

1 

1 

-0.26 

0.00 

0.19 

-0.20 

20A217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A218 

* 

-1 

3919 

98 

1.52 

0.02 

0.00 

0.02 

20A218 

A 

1 

55 

75 

1.52 

0.10 

0.95 

0.35 

20A218 

B 

0 

10 

14 

0.67 

0.20 

0.70 

-0.33 

20A218 

C 

0 

8 

11 

1.05 

0.37 

1.22 

-0.13 

20A218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A219 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

20A219 

A 

1 

68 

80 

1.90 

0.13 

0.83 

0.52 

20A219 

B 

0 

11 

13 

0.44 

0.20 

0.53 

-0.40 

20A219 

C 

0 

6 

7 

0.41 

0.28 

0.53 

-0.29 

20A219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A22 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

20A22 

A 

1 

52 

75 

2.26 

0.15 

1.01 

0.40 

20A22 

B 

0 

10 

14 

1.26 

0.26 

0.83 

-0.27 

20A22 

C 

0 

7 

10 

1.12 

0.37 

0.80 

-0.26 

20A22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2OA220 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

2OA220 

A 

1 

58 

88 

2.31 

0.18 

1.08 

0.38 

2OA220 

B 

0 

4 

6 

1.15 

0.50 

1.05 

-0.18 

2OA220 

C 

0 

4 

6 

0.25 

0.12 

0.30 

-0.34 

2OA220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A221 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.04 

20A221 

A 

1 

57 

86 

2.09 

0.19 

1.09 

0.28 

20A221 

B 

0 

3 

5 

0.95 

0.58 

1.04 

-0.14 

20A221 

C 

0 

6 

9 

0.86 

0.54 

1.30 

-0.23 

20A221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A222 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

20A222 

A 

1 

57 

86 

2.39 

0.18 

1.12 

0.23 

20A222 

B 

0 

4 

6 

2.15 

0.32 

1.84 

-0.02 

20A222 

C 

0 

5 

8 

0.97 

0.59 

0.97 

-0.28 

20A222 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A223 

* 

-1 

3834 

96 

1.50 

0.02 

0.00 

-0.05 

20A223 

A 

1 

114 

72 

2.25 

0.12 

1.00 

0.47 

20A223 

B 

0 

28 

18 

0.89 

0.14 

0.69 

-0.34 

20A223 

C 

0 

16 

10 

0.77 

0.28 

0.90 

-0.28 

20A223 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A224 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

20A224 

A 

1 

56 

80 

1.60 

0.14 

1.03 

0.31 

20A224 

B 

0 

7 

10 

0.48 

0.32 

0.71 

-0.29 

20A224 

C 

0 

7 

10 

1.02 

0.49 

1.78 

-0.12 

20A224 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A225 

* 

-1 

3902 

98 

1.51 

0.02 

0.00 

-0.03 

20A225 

A 

1 

78 

87 

1.97 

0.12 

0.87 

0.42 

20A225 

B 

0 

4 

4 

1.11 

0.63 

1.26 

-0.12 

20A225 

C 

0 

8 

9 

0.20 

0.24 

0.40 

-0.41 

20A225 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A226 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.01 

20A226 

A 

1 

73 

91 

1.57 

0.12 

0.95 

0.36 

20A226 

B 

0 

3 

4 

0.46 

0.42 

0.63 

-0.19 

20A226 

C 

0 

4 

5 

0.07 

0.26 

0.40 

-0.31 

20A226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A227 

* 

-1 

3857 

97 

1.50 

0.02 

0.00 

-0.07 

20A227 

A 

1 

132 

98 

2.08 

0.12 

1.01 

0.08 

20A227 

B 

0 

2 

1 

0.98 

1.58 

2.01 

-0.09 

20A227 

C 

0 

1 

1 

1.92 

0.00 

2.01 

-0.01 

20A227 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A228 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

20A228 

A 

1 

68 

89 

1.59 

0.13 

0.89 

0.42 

20A228 

B 

0 

4 

5 

-0.16 

0.28 

0.36 

-0.32 

20A228 

C 

0 

4 

5 

0.17 

0.22 

0.47 

-0.26 

20A228 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A229 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

20A229 

A 

1 

62 

78 

2.58 

0.16 

1.01 

0.41 

20A229 

B 

0 

6 

8 

0.97 

0.41 

0.58 

-0.29 

20A229 

C 

0 

12 

15 

1.45 

0.32 

1.00 

-0.27 

20A229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A23 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

20A23 

A 

1 

61 

88 

1.58 

0.18 

0.93 

0.37 

20A23 

B 

0 

5 

7 

0.07 

0.24 

0.57 

-0.25 

20A23 

C 

0 

3 

4 

-0.40 

0.31 

0.35 

-0.26 

20A23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2OA230 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

2OA230 

A 

1 

82 

98 

1.61 

0.13 

1.00 

0.18 

2OA230 

B 

0 

2 

2 

0.24 

0.07 

0.45 

-0.18 

2OA230 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2OA230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A231 

* 

-1 

3798 

95 

1.51 

0.02 

0.00 

-0.01 

20A231 

A 

1 

186 

96 

1.59 

0.08 

1.01 

0.09 

20A231 

B 

0 

4 

2 

1.18 

0.86 

2.71 

-0.05 

20A231 

C 

0 

4 

2 

1.08 

0.60 

1.42 

-0.07 

20A231 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A232 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

20A232 

A 

1 

62 

90 

1.60 

0.14 

1.07 

0.08 

20A232 

B 

0 

2 

3 

1.01 

0.70 

1.05 

-0.09 

20A232 

C 

0 

5 

7 

1.43 

0.36 

1.64 

-0.04 

20A232 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A233 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

20A233 

A 

1 

89 

92 

2.02 

0.11 

0.99 

0.29 

20A233 

B 

0 

6 

6 

1.16 

0.47 

1.41 

-0.17 

20A233 

C 

0 

2 

2 

-0.19 

0.20 

0.21 

-0.27 

20A233 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A234 

* 

-1 

3919 

98 

1.52 

0.02 

0.00 

0.02 

20A234 

A 

1 

69 

95 

1.42 

0.10 

0.93 

0.33 

20A234 

B 

0 

1 

1 

0.77 

0.00 

0.75 

-0.08 

20A234 

C 

0 

3 

4 

0.02 

0.54 

0.45 

-0.33 

20A234 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A235 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

20A235 

A 

1 

77 

91 

1.70 

0.13 

1.01 

0.25 

20A235 

B 

0 

6 

7 

0.85 

0.38 

1.12 

-0.19 

20A235 

C 

0 

2 

2 

0.35 

0.26 

0.46 

-0.17 

20A235 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A236 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

20A236 

A 

1 

62 

90 

2.11 

0.14 

0.97 

0.29 

20A236 

B 

0 

2 

3 

1.69 

1.59 

2.96 

-0.05 

20A236 

C 

0 

5 

7 

0.76 

0.35 

0.56 

-0.31 

20A236 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A237 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

20A237 

A 

1 

57 

86 

2.36 

0.17 

0.91 

0.44 

20A237 

B 

0 

6 

9 

0.19 

0.28 

0.31 

-0.44 

20A237 

C 

0 

3 

5 

1.34 

0.56 

1.07 

-0.12 

20A237 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A238 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.04 

20A238 

A 

1 

60 

91 

2.04 

0.19 

1.07 

0.25 

20A238 

B 

0 

5 

8 

0.93 

0.51 

1.35 

-0.19 

20A238 

C 

0 

1 

2 

-0.07 

0.00 

0.29 

-0.17 

20A238 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A239 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

20A239 

A 

1 

63 

95 

2.37 

0.16 

0.92 

0.35 

20A239 

B 

0 

2 

3 

0.44 

0.47 

0.38 

-0.24 

20A239 

C 

0 

1 

2 

-0.41 

0.00 

0.14 

-0.25 

20A239 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A24 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

20A24 

A 

1 

58 

83 

1.66 

0.14 

0.95 

0.45 

20A24 

B 

0 

4 

6 

0.29 

0.35 

0.54 

-0.25 

20A24 

C 

0 

8 

11 

0.34 

0.26 

0.61 

-0.35 

20A24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2OA240 

* 

-1 

3903 

98 

1.51 

0.02 

0.00 

-0.03 

2OA240 

A 

1 

81 

91 

1.95 

0.12 

0.89 

0.42 

2OA240 

B 

0 

2 

2 

0.41 

0.46 

0.44 

-0.18 

2OA240 

C 

0 

6 

7 

0.20 

0.28 

0.39 

-0.37 

2OA240 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A25 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.01 

20A25 

A 

1 

61 

76 

1.72 

0.13 

0.91 

0.45 

20A25 

B 

0 

8 

10 

0.48 

0.24 

0.56 

-0.31 

20A25 

C 

0 

11 

14 

0.71 

0.22 

0.73 

-0.29 

20A25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A26 

* 

-1 

3916 

98 

1.52 

0.02 

0.00 

0.01 

20A26 

A 

1 

60 

79 

1.63 

0.15 

0.98 

0.33 

20A26 

B 

0 

7 

9 

0.68 

0.42 

1.05 

-0.21 

20A26 

C 

0 

9 

12 

0.68 

0.34 

1.28 

-0.24 

20A26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A27 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

20A27 

A 

1 

65 

81 

2.56 

0.15 

0.96 

0.43 

20A27 

B 

0 

8 

10 

0.59 

0.34 

0.41 

-0.44 

20A27 

C 

0 

7 

9 

1.71 

0.34 

1.22 

-0.14 

20A27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A28 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

20A28 

A 

1 

44 

64 

1.86 

0.22 

0.99 

0.43 

20A28 

B 

0 

7 

10 

0.49 

0.48 

1.25 

-0.21 

20A28 

C 

0 

18 

26 

0.57 

0.22 

0.98 

-0.33 

20A28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A29 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

20A29 

A 

1 

67 

80 

1.77 

0.14 

1.05 

0.34 

20A29 

B 

0 

4 

5 

0.34 

0.06 

0.41 

-0.24 

20A29 

C 

0 

13 

15 

0.96 

0.25 

1.05 

-0.23 

20A29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A31 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

20A31 

A 

1 

41 

59 

1.94 

0.17 

1.05 

0.43 

20A31 

B 

0 

11 

16 

1.12 

0.20 

0.88 

-0.19 

20A31 

C 

0 

17 

25 

0.95 

0.18 

0.79 

-0.34 

20A31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2OA310 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

2OA310 

A 

1 

94 

97 

1.94 

0.12 

1.03 

0.10 

2OA310 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2OA310 

C 

0 

3 

3 

1.30 

0.78 

1.71 

-0.10 

2OA310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A311 

* 

-1 

3919 

98 

1.52 

0.02 

0.00 

0.02 

20A311 

A 

1 

56 

77 

1.56 

0.10 

0.92 

0.45 

20A311 

B 

0 

8 

11 

0.73 

0.25 

0.81 

-0.26 

20A311 

C 

0 

9 

12 

0.61 

0.24 

0.66 

-0.33 

20A311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A312 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

20A312 

A 

1 

68 

80 

1.82 

0.13 

0.94 

0.38 

20A312 

B 

0 

12 

14 

0.62 

0.22 

0.68 

-0.35 

20A312 

C 

0 

5 

6 

1.08 

0.60 

1.58 

-0.12 

20A312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A313 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

20A313 

A 

1 

58 

84 

2.20 

0.14 

0.95 

0.40 

20A313 

B 

0 

7 

10 

0.87 

0.28 

0.59 

-0.34 

20A313 

C 

0 

4 

6 

1.12 

0.56 

0.87 

-0.19 

20A313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A314 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

20A314 

A 

1 

55 

83 

2.41 

0.18 

1.11 

0.48 

20A314 

B 

0 

7 

11 

0.67 

0.17 

0.44 

-0.36 

20A314 

C 

0 

4 

6 

0.57 

0.09 

0.37 

-0.28 

20A314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A315 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.04 

20A315 

A 

1 

49 

74 

2.40 

0.19 

0.86 

0.55 

20A315 

B 

0 

3 

5 

0.42 

0.70 

0.59 

-0.22 

20A315 

C 

0 

14 

21 

0.58 

0.25 

0.60 

-0.48 

20A315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A316 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

20A316 

A 

1 

46 

70 

2.76 

0.17 

0.91 

0.56 

20A316 

B 

0 

8 

12 

1.67 

0.37 

1.15 

-0.17 

20A316 

C 

0 

12 

18 

0.79 

0.22 

0.42 

-0.53 

20A316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A317 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

20A317 

A 

1 

62 

89 

1.56 

0.14 

1.00 

0.32 

20A317 

B 

0 

3 

4 

0.41 

0.65 

0.80 

-0.19 

20A317 

C 

0 

5 

7 

0.44 

0.27 

0.65 

-0.25 

20A317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A318 

* 

-1 

3903 

98 

1.51 

0.02 

0.00 

-0.03 

20A318 

A 

1 

70 

79 

2.03 

0.14 

1.03 

0.38 

20A318 

B 

0 

13 

15 

1.05 

0.23 

0.89 

-0.27 

20A318 

C 

0 

6 

7 

0.77 

0.31 

0.63 

-0.24 

20A318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A319 

* 

-1 

3852 

96 

1.50 

0.02 

0.00 

-0.04 

20A319 

A 

1 

115 

82 

2.05 

0.12 

1.00 

0.40 

20A319 

B 

0 

13 

9 

0.35 

0.21 

0.50 

-0.36 

20A319 

C 

0 

12 

9 

1.08 

0.29 

1.17 

-0.17 

20A319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20  A3  2 

* 

-1 

3819 

96 

1.52 

0.02 

0.00 

0.01 

20A32 

A 

1 

125 

72 

1.66 

0.09 

1.08 

0.35 

20  A3  2 

B 

0 

15 

9 

0.89 

0.21 

0.94 

-0.17 

20A32 

C 

0 

33 

19 

0.87 

0.11 

0.85 

-0.28 

20A32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2OA320 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.01 

2OA320 

A 

1 

43 

54 

1.83 

0.15 

0.97 

0.39 

2OA320 

B 

0 

17 

21 

1.06 

0.17 

0.92 

-0.20 

2OA320 

C 

0 

20 

25 

0.98 

0.24 

1.25 

-0.26 

2OA320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A321 

* 

-1 

3917 

98 

1.52 

0.02 

0.00 

0.01 

20A321 

A 

1 

58 

77 

1.66 

0.15 

1.03 

0.36 

20A321 

B 

0 

8 

11 

0.25 

0.23 

0.50 

-0.35 

20A321 

C 

0 

9 

12 

1.03 

0.21 

1.07 

-0.13 

20A321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A322 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

20A322 

A 

1 

66 

83 

2.55 

0.15 

0.93 

0.44 

20A322 

B 

0 

7 

9 

0.95 

0.40 

0.60 

-0.32 

20A322 

C 

0 

7 

9 

1.15 

0.44 

0.95 

-0.27 

20A322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A323 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

20A323 

A 

1 

50 

72 

1.74 

0.21 

0.98 

0.40 

20A323 

B 

0 

11 

16 

0.61 

0.32 

1.30 

-0.23 

20A323 

C 

0 

8 

12 

0.23 

0.34 

0.81 

-0.29 

20A323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A324 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

20A324 

A 

1 

56 

67 

2.01 

0.14 

0.87 

0.52 

20A324 

B 

0 

14 

17 

0.79 

0.21 

0.73 

-0.31 

20A324 

C 

0 

14 

17 

0.66 

0.22 

0.68 

-0.35 

20A324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A325 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

20A325 

A 

1 

41 

59 

1.96 

0.17 

1.04 

0.45 

20A325 

B 

0 

10 

14 

1.28 

0.24 

1.03 

-0.11 

20A325 

C 

0 

18 

26 

0.84 

0.14 

0.65 

-0.41 

20A325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A326 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

20A326 

A 

1 

86 

89 

2.09 

0.11 

0.93 

0.42 

20A326 

B 

0 

2 

2 

0.08 

0.20 

0.26 

-0.24 

20A326 

C 

0 

9 

9 

0.72 

0.37 

0.97 

-0.34 

20A326 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A327 

* 

-1 

3919 

98 

1.52 

0.02 

0.00 

0.02 

20A327 

A 

1 

42 

58 

1.54 

0.13 

1.16 

0.26 

20A327 

B 

0 

25 

34 

1.25 

0.15 

1.27 

-0.09 

20A327 

C 

0 

6 

8 

0.46 

0.26 

0.50 

-0.32 

20A327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A328 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

20A328 

A 

1 

62 

73 

1.84 

0.15 

1.07 

0.33 

20A328 

B 

0 

10 

12 

0.98 

0.26 

1.02 

-0.20 

20A328 

C 

0 

13 

15 

1.00 

0.25 

1.01 

-0.23 

20A328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A329 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

20A329 

A 

1 

57 

83 

2.23 

0.14 

0.92 

0.43 

20A329 

B 

0 

4 

6 

1.24 

0.48 

0.92 

-0.17 

20A329 

C 

0 

8 

12 

0.80 

0.31 

0.59 

-0.38 

20A329 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20  A3  3 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

20A33 

A 

1 

51 

77 

2.53 

0.18 

1.06 

0.56 

20A33 

B 

0 

10 

15 

0.72 

0.21 

0.50 

-0.43 

20A33 

C 

0 

5 

8 

0.59 

0.19 

0.36 

-0.32 

20A33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2OA330 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.04 

2OA330 

A 

1 

57 

86 

2.18 

0.18 

0.94 

0.45 

2OA330 

B 

0 

6 

9 

0.44 

0.36 

0.63 

-0.32 

2OA330 

C 

0 

3 

5 

-0.06 

0.36 

0.31 

-0.29 

2OA330 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A331 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

20A331 

A 

1 

58 

88 

2.43 

0.17 

1.09 

0.32 

20A331 

B 

0 

3 

5 

1.61 

0.42 

1.11 

-0.11 

20A331 

C 

0 

5 

8 

0.82 

0.35 

0.55 

-0.31 

20A331 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A332 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

20A332 

A 

1 

59 

84 

1.69 

0.13 

0.83 

0.53 

20A332 

B 

0 

8 

11 

-0.01 

0.24 

0.43 

-0.47 

20A332 

C 

0 

3 

4 

0.23 

0.43 

0.54 

-0.23 

20A332 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A333 

* 

-1 

3903 

98 

1.51 

0.02 

0.00 

-0.03 

20A333 

A 

1 

66 

74 

2.17 

0.13 

0.84 

0.53 

20A333 

B 

0 

11 

12 

0.70 

0.25 

0.58 

-0.35 

20A333 

C 

0 

12 

13 

0.79 

0.19 

0.58 

-0.34 

20A333 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A334 

* 

-1 

3839 

96 

1.50 

0.02 

0.00 

-0.05 

20A334 

A 

1 

126 

82 

2.10 

0.13 

1.07 

0.36 

20A334 

B 

0 

10 

7 

0.51 

0.21 

0.59 

-0.25 

20A334 

C 

0 

17 

11 

0.86 

0.28 

1.33 

-0.24 

20A334 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A335 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.01 

20A335 

A 

1 

76 

95 

1.54 

0.11 

0.91 

0.36 

20A335 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A335 

C 

0 

4 

5 

-0.16 

0.35 

0.36 

-0.36 

20A335 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A336 

* 

-1 

3917 

98 

1.52 

0.02 

0.00 

0.01 

20A336 

A 

1 

53 

71 

1.67 

0.17 

1.13 

0.31 

20A336 

B 

0 

13 

17 

0.96 

0.19 

0.96 

-0.19 

20A336 

C 

0 

9 

12 

0.77 

0.35 

1.24 

-0.21 

20A336 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A337 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

20A337 

A 

1 

74 

93 

2.40 

0.15 

0.98 

0.30 

20A337 

B 

0 

1 

1 

-1.05 

0.00 

0.07 

-0.29 

20A337 

C 

0 

5 

6 

1.30 

0.36 

1.00 

-0.20 

20A337 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A338 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

20A338 

A 

1 

62 

90 

1.54 

0.18 

0.96 

0.32 

20A338 

B 

0 

4 

6 

-0.10 

0.40 

0.56 

-0.25 

20A338 

C 

0 

3 

4 

0.10 

0.36 

0.62 

-0.19 

20A338 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A339 

* 

-1 

3839 

96 

1.51 

0.02 

0.00 

-0.01 

20A339 

A 

1 

116 

76 

1.91 

0.10 

0.89 

0.53 

20A339 

B 

0 

22 

14 

0.45 

0.08 

0.46 

-0.42 

20A339 

C 

0 

15 

10 

0.65 

0.19 

0.69 

-0.27 

20A339 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A34 

* 

-1 

3839 

96 

1.51 

0.02 

0.00 

-0.01 

20A34 

A 

1 

103 

67 

1.90 

0.11 

0.99 

0.42 

20A34 

B 

0 

27 

18 

0.67 

0.14 

0.64 

-0.38 

20  A3  4 

C 

0 

23 

15 

1.19 

0.19 

1.36 

-0.15 

20A34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2OA340 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

2OA340 

A 

1 

84 

87 

2.08 

0.11 

0.96 

0.36 

2OA340 

B 

0 

2 

2 

0.36 

0.35 

0.34 

-0.20 

2OA340 

C 

0 

11 

11 

0.97 

0.40 

1.52 

-0.30 

2OA340 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A35 

* 

-1 

3919 

98 

1.52 

0.02 

0.00 

0.02 

20A35 

A 

1 

48 

66 

1.48 

0.11 

1.04 

0.22 

20A35 

B 

0 

15 

21 

1.17 

0.27 

1.51 

-0.11 

20A35 

C 

0 

10 

14 

0.99 

0.25 

1.00 

-0.17 

20  A3  5 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20  A3  6 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

20A36 

A 

1 

74 

87 

1.79 

0.13 

0.92 

0.42 

20  A3  6 

B 

0 

4 

5 

0.65 

0.25 

0.64 

-0.19 

20A36 

C 

0 

7 

8 

0.21 

0.21 

0.43 

-0.37 

20A36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A37 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

20A37 

A 

1 

60 

87 

2.19 

0.14 

0.91 

0.42 

20A37 

B 

0 

6 

9 

0.74 

0.43 

0.69 

-0.34 

20A37 

C 

0 

3 

4 

0.85 

0.25 

0.51 

-0.22 

20A37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20  A3  8 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

20A38 

A 

1 

53 

80 

2.47 

0.17 

0.84 

0.52 

20A38 

B 

0 

5 

8 

0.79 

0.17 

0.47 

-0.27 

20  A3  8 

C 

0 

8 

12 

0.60 

0.45 

0.76 

-0.41 

20A38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A39 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.04 

20A39 

A 

1 

53 

80 

2.38 

0.17 

0.72 

0.62 

20A39 

B 

0 

6 

9 

0.05 

0.19 

0.29 

-0.40 

20A39 

C 

0 

7 

11 

0.09 

0.27 

0.36 

-0.43 

20  A3  9 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A41 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

20A41 

A 

1 

64 

97 

2.35 

0.16 

0.91 

0.33 

20A41 

B 

0 

2 

3 

-0.22 

0.19 

0.18 

-0.33 

20A41 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

2OA410 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2OA410 

A 

1 

64 

91 

1.59 

0.13 

0.86 

0.47 

2OA410 

B 

0 

3 

4 

0.03 

0.28 

0.42 

-0.27 

2OA410 

C 

0 

3 

4 

-0.57 

0.12 

0.22 

-0.38 

2OA410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A411 

* 

-1 

3903 

98 

1.51 

0.02 

0.00 

-0.03 

20A411 

A 

1 

82 

92 

1.91 

0.13 

0.95 

0.32 

20A411 

B 

0 

3 

3 

0.10 

0.54 

0.40 

-0.27 

20A411 

C 

0 

4 

4 

0.88 

0.37 

0.78 

-0.17 

20A411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A412 

* 

-1 

3836 

96 

1.52 

0.02 

0.00 

0.01 

20A412 

A 

1 

155 

99 

1.49 

0.10 

0.98 

0.14 

20A412 

B 

0 

1 

1 

-0.71 

0.00 

0.22 

-0.14 

20A412 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A413 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.01 

20A413 

A 

1 

63 

79 

1.63 

0.13 

1.02 

0.32 

20A413 

B 

0 

8 

10 

0.64 

0.22 

0.67 

-0.26 

20A413 

C 

0 

9 

11 

0.98 

0.34 

1.25 

-0.17 

20A413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A414 

* 

-1 

3917 

98 

1.52 

0.02 

0.00 

0.01 

20A414 

A 

1 

40 

53 

1.78 

0.20 

1.33 

0.32 

20A414 

B 

0 

17 

23 

1.10 

0.24 

1.35 

-0.16 

20A414 

C 

0 

18 

24 

0.98 

0.19 

1.03 

-0.22 

20A414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A415 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

20A415 

A 

1 

71 

89 

2.47 

0.15 

0.91 

0.39 

20A415 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A415 

C 

0 

9 

11 

0.88 

0.39 

0.77 

-0.39 

20A415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A416 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

20A416 

A 

1 

61 

88 

1.57 

0.18 

0.94 

0.35 

20A416 

B 

0 

2 

3 

0.66 

0.29 

0.96 

-0.09 

20A416 

C 

0 

6 

9 

-0.24 

0.27 

0.47 

-0.34 

20A416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A417 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

20A417 

A 

1 

79 

94 

1.66 

0.12 

0.91 

0.29 

20A417 

B 

0 

4 

5 

0.53 

0.67 

1.13 

-0.20 

20A417 

C 

0 

1 

1 

-0.79 

0.00 

0.15 

-0.23 

20A417 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A418 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

20A418 

A 

1 

67 

97 

1.60 

0.13 

0.99 

0.19 

20A418 

B 

0 

2 

3 

0.44 

0.26 

0.52 

-0.19 

20A418 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A419 

* 

-1 

3818 

96 

1.51 

0.02 

0.00 

-0.02 

20A419 

A 

1 

161 

93 

1.73 

0.09 

0.98 

0.26 

20A419 

B 

0 

3 

2 

0.83 

0.60 

0.93 

-0.10 

20A419 

C 

0 

10 

6 

0.54 

0.30 

0.78 

-0.24 

20A419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A42 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

20A42 

A 

1 

95 

98 

1.97 

0.11 

0.94 

0.30 

20A42 

B 

0 

1 

1 

-0.26 

0.00 

0.21 

-0.20 

20A42 

C 

0 

1 

1 

-0.53 

0.00 

0.16 

-0.22 

20A42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2OA420 

* 

-1 

3919 

98 

1.52 

0.02 

0.00 

0.02 

2OA420 

A 

1 

46 

63 

1.47 

0.12 

1.16 

0.18 

2OA420 

B 

0 

3 

4 

0.53 

0.48 

0.58 

-0.20 

2OA420 

C 

0 

24 

33 

1.23 

0.18 

1.40 

-0.10 

2OA420 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A421 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

20A421 

A 

1 

81 

95 

1.67 

0.13 

0.99 

0.23 

20A421 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A421 

C 

0 

4 

5 

0.41 

0.24 

0.53 

-0.23 

20A421 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A422 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

20A422 

A 

-1 

69 

100 

2.00 

0.14 

0.00 

0.00 

20A422 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A422 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A422 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A423 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

20A423 

A 

1 

63 

95 

2.14 

0.17 

1.05 

0.09 

20A423 

B 

0 

2 

3 

1.98 

2.17 

8.38 

-0.02 

20A423 

C 

0 

1 

2 

0.64 

0.00 

0.49 

-0.13 

20A423 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

easyCBM  CCSS  Second  Grade  Math  Measure  Development 


557 

Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A424 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.04 

20A424 

A 

1 

63 

95 

2.01 

0.18 

0.95 

0.27 

20A424 

B 

0 

2 

3 

0.50 

1.10 

0.93 

-0.17 

20A424 

C 

0 

1 

2 

-0.60 

0.00 

0.19 

-0.21 

20A424 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A425 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

20A425 

A 

1 

53 

80 

2.65 

0.16 

0.80 

0.58 

20A425 

B 

0 

13 

20 

0.72 

0.23 

0.48 

-0.58 

20A425 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A425 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A426 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

20A426 

A 

1 

28 

40 

2.13 

0.21 

1.07 

0.52 

20A426 

B 

0 

17 

24 

0.98 

0.23 

0.80 

-0.23 

20A426 

C 

0 

25 

36 

0.95 

0.16 

0.76 

-0.32 

20A426 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A427 

* 

-1 

3854 

97 

1.50 

0.02 

0.00 

-0.07 

20A427 

A 

1 

94 

68 

2.45 

0.13 

1.10 

0.46 

20A427 

B 

0 

13 

9 

0.92 

0.28 

0.63 

-0.28 

20A427 

C 

0 

31 

22 

1.27 

0.18 

1.15 

-0.32 

20A427 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A428 

* 

-1 

3903 

98 

1.51 

0.02 

0.00 

-0.03 

20A428 

A 

1 

71 

80 

2.05 

0.13 

0.97 

0.42 

20A428 

B 

0 

16 

18 

0.91 

0.19 

0.76 

-0.36 

20A428 

C 

0 

2 

2 

0.14 

0.45 

0.30 

-0.22 

20A428 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A429 

* 

-1 

3912 

98 

1.52 

0.02 

0.00 

0.01 

20A429 

A 

1 

66 

83 

1.65 

0.12 

0.94 

0.41 

20A429 

B 

0 

12 

15 

0.51 

0.20 

0.62 

-0.38 

20A429 

C 

0 

2 

3 

0.61 

0.58 

0.67 

-0.13 

20A429 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A43 

* 

-1 

3917 

98 

1.52 

0.02 

0.00 

0.01 

20A43 

A 

1 

73 

97 

1.49 

0.13 

0.94 

0.29 

20A43 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A43 

C 

0 

2 

3 

-0.56 

0.19 

0.23 

-0.29 

20A43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2OA430 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

2OA430 

A 

1 

71 

89 

2.53 

0.14 

0.79 

0.52 

2OA430 

B 

0 

7 

9 

0.04 

0.23 

0.22 

-0.53 

2OA430 

C 

0 

2 

3 

1.59 

0.17 

0.92 

-0.09 

2OA430 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A431 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

20A431 

A 

1 

54 

78 

1.74 

0.19 

0.91 

0.46 

20A431 

B 

0 

8 

12 

0.03 

0.20 

0.50 

-0.34 

20A431 

C 

0 

7 

10 

0.19 

0.28 

0.64 

-0.28 

20A431 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A432 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

20A432 

A 

1 

58 

69 

1.71 

0.16 

1.27 

0.17 

20A432 

B 

0 

4 

5 

0.28 

0.45 

0.44 

-0.25 

20A432 

C 

0 

22 

26 

1.48 

0.20 

1.67 

-0.05 

20A432 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A433 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

0.00 

20A433 

A 

1 

48 

70 

1.90 

0.14 

0.92 

0.47 

20A433 

B 

0 

10 

14 

0.64 

0.28 

0.88 

-0.36 

20A433 

C 

0 

11 

16 

0.98 

0.22 

0.91 

-0.25 

20A433 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A434 

* 

-1 

3895 

98 

1.51 

0.02 

0.00 

-0.04 

20A434 

A 

1 

70 

72 

2.33 

0.11 

0.76 

0.60 

20A434 

B 

0 

3 

3 

-0.02 

0.38 

0.21 

-0.31 

20A434 

C 

0 

24 

25 

0.95 

0.20 

0.84 

-0.49 

20A434 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A435 

* 

-1 

3920 

98 

1.52 

0.02 

0.00 

0.02 

20A435 

A 

1 

49 

68 

1.58 

0.11 

0.93 

0.41 

20A435 

B 

0 

13 

18 

0.98 

0.17 

0.92 

-0.21 

20A435 

C 

0 

10 

14 

0.69 

0.30 

0.82 

-0.31 

20A435 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A436 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

20A436 

A 

1 

54 

64 

1.92 

0.15 

1.05 

0.36 

20A436 

B 

0 

22 

26 

1.24 

0.22 

1.46 

-0.19 

20A436 

C 

0 

9 

11 

0.63 

0.20 

0.53 

-0.30 

20A436 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A437 

* 

-1 

3923 

98 

1.51 

0.02 

0.00 

-0.04 

20A437 

A 

1 

60 

87 

2.07 

0.15 

1.11 

0.15 

20A437 

B 

0 

3 

4 

0.77 

0.41 

0.53 

-0.23 

20A437 

C 

0 

6 

9 

1.96 

0.46 

2.21 

-0.01 

20A437 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A438 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.05 

20A438 

A 

1 

51 

77 

2.38 

0.19 

1.26 

0.36 

20A438 

B 

0 

6 

9 

0.78 

0.29 

0.52 

-0.31 

20A438 

C 

0 

9 

14 

1.47 

0.41 

1.54 

-0.19 

20A438 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A439 

* 

-1 

3926 

98 

1.51 

0.02 

0.00 

-0.04 

20A439 

A 

1 

45 

68 

2.31 

0.22 

1.33 

0.39 

20A439 

B 

0 

16 

24 

1.11 

0.28 

1.14 

-0.31 

20A439 

C 

0 

5 

8 

1.04 

0.41 

0.79 

-0.17 

20A439 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A44 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

20A44 

A 

1 

62 

94 

2.40 

0.16 

0.89 

0.37 

20A44 

B 

0 

1 

2 

-0.16 

0.00 

0.18 

-0.23 

20A44 

C 

0 

3 

5 

0.49 

0.72 

0.60 

-0.29 

20A44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2OA440 

* 

-1 

3922 

98 

1.52 

0.02 

0.00 

0.01 

2OA440 

A 

1 

60 

86 

1.61 

0.14 

0.94 

0.40 

2OA440 

B 

0 

4 

6 

0.10 

0.29 

0.44 

-0.29 

2OA440 

C 

0 

6 

9 

0.51 

0.42 

0.90 

-0.25 

2OA440 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A45 

* 

-1 

3903 

98 

1.51 

0.02 

0.00 

-0.03 

20A45 

A 

1 

87 

98 

1.84 

0.12 

0.96 

0.24 

20A45 

B 

0 

1 

1 

0.46 

0.00 

0.46 

-0.12 

20A45 

C 

0 

1 

1 

-0.56 

0.00 

0.17 

-0.22 

20A45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix  E:  Distractor  Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg.  Prsn  Msr 

SE 

OUT.MSQ 

PTME 

20A46 

* 

-1 

3913 

98 

1.52 

0.02 

0.00 

0.01 

20A46 

A 

1 

76 

96 

1.50 

0.12 

0.97 

0.24 

20A46 

B 

0 

2 

3 

0.28 

0.90 

0.69 

-0.18 

20A46 

C 

0 

1 

1 

0.03 

0.00 

0.37 

-0.15 

20A46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A47 

* 

-1 

3917 

98 

1.52 

0.02 

0.00 

0.01 

20A47 

A 

1 

70 

93 

1.53 

0.14 

0.95 

0.31 

20A47 

B 

0 

1 

1 

0.49 

0.00 

0.63 

-0.10 

20A47 

C 

0 

4 

5 

0.01 

0.39 

0.51 

-0.29 

20A47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A48 

* 

-1 

3912 

98 

1.50 

0.02 

0.00 

-0.08 

20A48 

A 

1 

76 

95 

2.42 

0.14 

0.81 

0.45 

20A48 

B 

0 

1 

1 

-0.02 

0.00 

0.20 

-0.20 

20A48 

C 

0 

3 

4 

-0.32 

0.44 

0.18 

-0.40 

20A48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

20A49 

* 

-1 

3923 

98 

1.52 

0.02 

0.00 

0.01 

20A49 

A 

1 

60 

87 

1.56 

0.18 

0.95 

0.31 

20A49 

B 

0 

4 

6 

0.38 

0.88 

2.55 

-0.17 

20A49 

C 

0 

5 

7 

0.13 

0.30 

0.62 

-0.24 

20A49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

21596 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.02 

21596 

A 

1 

42 

93 

1.99 

0.21 

0.97 

0.44 

21596 

B 

0 

2 

4 

-0.76 

0.67 

0.23 

-0.38 

21596 

C 

0 

1 

2 

-0.26 

0.00 

0.30 

-0.21 

21596 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

